Apr 13 20:12:26 user devstack@n-api.service[61652]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 13 20:12:26 user devstack@n-api.service[61652]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 13 20:12:26 2023] *** Apr 13 20:12:26 user devstack@n-api.service[61652]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 13 20:12:26 user devstack@n-api.service[61652]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 13 20:12:26 user devstack@n-api.service[61652]: nodename: user Apr 13 20:12:26 user devstack@n-api.service[61652]: machine: x86_64 Apr 13 20:12:26 user devstack@n-api.service[61652]: clock source: unix Apr 13 20:12:26 user devstack@n-api.service[61652]: pcre jit disabled Apr 13 20:12:26 user devstack@n-api.service[61652]: detected number of CPU cores: 12 Apr 13 20:12:26 user devstack@n-api.service[61652]: current working directory: / Apr 13 20:12:26 user devstack@n-api.service[61652]: detected binary path: /usr/bin/uwsgi-core Apr 13 20:12:26 user devstack@n-api.service[61652]: your processes number limit is 63638 Apr 13 20:12:26 user devstack@n-api.service[61652]: your memory page size is 4096 bytes Apr 13 20:12:26 user devstack@n-api.service[61652]: detected max file descriptor number: 2048 Apr 13 20:12:26 user devstack@n-api.service[61652]: lock engine: pthread robust mutexes Apr 13 20:12:26 user devstack@n-api.service[61652]: thunder lock: enabled Apr 13 20:12:26 user devstack@n-api.service[61652]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 13 20:12:26 user devstack@n-api.service[61652]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 13 20:12:26 user devstack@n-api.service[61652]: Python main interpreter initialized at 0x5622664ea990 Apr 13 20:12:26 user devstack@n-api.service[61652]: python threads support enabled Apr 13 20:12:26 user devstack@n-api.service[61652]: your server socket listen backlog is limited to 100 connections Apr 13 20:12:26 user devstack@n-api.service[61652]: your mercy for graceful operations on workers is 90 seconds Apr 13 20:12:26 user devstack@n-api.service[61652]: mapped 537436 bytes (524 KB) for 3 cores Apr 13 20:12:26 user devstack@n-api.service[61652]: *** Operational MODE: preforking *** Apr 13 20:12:26 user devstack@n-api.service[61652]: *** uWSGI is running in multiple interpreter mode *** Apr 13 20:12:26 user devstack@n-api.service[61652]: spawned uWSGI master process (pid: 61652) Apr 13 20:12:26 user devstack@n-api.service[61652]: spawned uWSGI worker 1 (pid: 61653, cores: 1) Apr 13 20:12:26 user devstack@n-api.service[61652]: spawned uWSGI worker 2 (pid: 61654, cores: 1) Apr 13 20:12:26 user devstack@n-api.service[61652]: spawned uWSGI worker 3 (pid: 61655, cores: 1) Apr 13 20:12:26 user devstack@n-api.service[61652]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 13 20:12:26 user devstack@n-api.service[61654]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 20:12:26 user devstack@n-api.service[61653]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 20:12:26 user devstack@n-api.service[61655]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 20:12:30 user devstack@n-api.service[61654]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 20:12:30 user devstack@n-api.service[61654]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 20:12:30 user devstack@n-api.service[61654]: and ``live_migration_inbound_addr`` respectively. Apr 13 20:12:30 user devstack@n-api.service[61654]: ). Its value may be silently ignored in the future. Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 20:12:30 user devstack@n-api.service[61653]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 20:12:30 user devstack@n-api.service[61653]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 20:12:30 user devstack@n-api.service[61653]: and ``live_migration_inbound_addr`` respectively. Apr 13 20:12:30 user devstack@n-api.service[61653]: ). Its value may be silently ignored in the future. Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 20:12:30 user devstack@n-api.service[61655]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 20:12:30 user devstack@n-api.service[61655]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 20:12:30 user devstack@n-api.service[61655]: and ``live_migration_inbound_addr`` respectively. Apr 13 20:12:30 user devstack@n-api.service[61655]: ). Its value may be silently ignored in the future. Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61654) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61653) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61655) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 20:12:30 user devstack@n-api.service[61655]: INFO dbcounter [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Registered counter for database nova_api Apr 13 20:12:30 user devstack@n-api.service[61653]: INFO dbcounter [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Registered counter for database nova_api Apr 13 20:12:30 user devstack@n-api.service[61654]: INFO dbcounter [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Registered counter for database nova_api Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_db.sqlalchemy.engines [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61655) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writer thread running {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_db.sqlalchemy.engines [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61653) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_db.sqlalchemy.engines [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61654) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writer thread running {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writer thread running {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG nova.context [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c581c091-39a2-47af-87ba-30e69c5146d4(cell1) {{(pid=61655) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:12:30 user devstack@n-api.service[61655]: INFO dbcounter [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Registered counter for database nova_cell0 Apr 13 20:12:30 user devstack@n-api.service[61655]: INFO dbcounter [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Registered counter for database nova_cell1 Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG nova.context [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c581c091-39a2-47af-87ba-30e69c5146d4(cell1) {{(pid=61653) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG nova.context [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c581c091-39a2-47af-87ba-30e69c5146d4(cell1) {{(pid=61654) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_db.sqlalchemy.engines [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61655) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_db.sqlalchemy.engines [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61655) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:12:30 user devstack@n-api.service[61653]: INFO dbcounter [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Registered counter for database nova_cell0 Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writer thread running {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61654]: INFO dbcounter [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Registered counter for database nova_cell0 Apr 13 20:12:30 user devstack@n-api.service[61653]: INFO dbcounter [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Registered counter for database nova_cell1 Apr 13 20:12:30 user devstack@n-api.service[61654]: INFO dbcounter [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Registered counter for database nova_cell1 Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_db.sqlalchemy.engines [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61653) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writer thread running {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_db.sqlalchemy.engines [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61654) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writer thread running {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_db.sqlalchemy.engines [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61653) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_db.sqlalchemy.engines [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61654) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writer thread running {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61655]: INFO dbcounter [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Registered counter for database nova_cell0 Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG oslo_db.sqlalchemy.engines [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61655) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writer thread running {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writer thread running {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writer thread running {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61653]: INFO dbcounter [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Registered counter for database nova_cell0 Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG oslo_db.sqlalchemy.engines [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61653) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writer thread running {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61654]: INFO dbcounter [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Registered counter for database nova_cell0 Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG oslo_db.sqlalchemy.engines [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61654) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 20:12:30 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writer thread running {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 20:12:30 user devstack@n-api.service[61655]: WARNING keystonemiddleware.auth_token [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 20:12:30 user devstack@n-api.service[61655]: WARNING keystonemiddleware.auth_token [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 20:12:30 user devstack@n-api.service[61653]: WARNING keystonemiddleware.auth_token [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 20:12:30 user devstack@n-api.service[61654]: WARNING keystonemiddleware.auth_token [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 20:12:30 user devstack@n-api.service[61653]: WARNING keystonemiddleware.auth_token [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 20:12:30 user devstack@n-api.service[61654]: WARNING keystonemiddleware.auth_token [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 20:12:31 user devstack@n-api.service[61653]: WARNING keystonemiddleware.auth_token [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 20:12:31 user devstack@n-api.service[61653]: WARNING keystonemiddleware.auth_token [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 20:12:31 user devstack@n-api.service[61653]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622664ea990 pid: 61653 (default app) Apr 13 20:12:31 user devstack@n-api.service[61654]: WARNING keystonemiddleware.auth_token [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 20:12:31 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:12:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.002675 Apr 13 20:12:31 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 13 20:12:31 2023] GET /compute/v2.1/ => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:12:31 user devstack@n-api.service[61654]: WARNING keystonemiddleware.auth_token [None req-9102f4a7-b1cf-4d0e-9b71-3022552305b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 20:12:31 user devstack@n-api.service[61654]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622664ea990 pid: 61654 (default app) Apr 13 20:12:31 user devstack@n-api.service[61655]: WARNING keystonemiddleware.auth_token [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 20:12:31 user devstack@n-api.service[61655]: WARNING keystonemiddleware.auth_token [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 20:12:31 user devstack@n-api.service[61655]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622664ea990 pid: 61655 (default app) Apr 13 20:14:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7389c11f-38b6-41b4-9a0b-63b0b21584e1 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001379 Apr 13 20:14:38 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:38 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:38 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:38 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:38 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:38 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:38 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-60ec1258-f5e6-4cfe-b502-693c1aa6219e admin admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-60ec1258-f5e6-4cfe-b502-693c1aa6219e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.399086 Apr 13 20:14:38 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 20:14:38 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001813 Apr 13 20:14:40 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:40 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6ab6024d-9487-4d95-9197-a79dd8143147 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "swap": 0, "disk": 1}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6ab6024d-9487-4d95-9197-a79dd8143147 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.317667 Apr 13 20:14:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:40 2023] POST /compute/v2.1/flavors => generated 405 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:41 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6ccbfbee-1a9a-49dc-b0a6-9aeeae335e2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:41 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6ccbfbee-1a9a-49dc-b0a6-9aeeae335e2f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045221 Apr 13 20:14:41 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 20:14:41 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001298 Apr 13 20:14:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:43 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-44e9da3c-902d-4ba9-b94f-fba180bb18a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-44e9da3c-902d-4ba9-b94f-fba180bb18a8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060019 Apr 13 20:14:43 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:42 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-97c8b668-c7dc-4b58-9d11-e331072f18e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-97c8b668-c7dc-4b58-9d11-e331072f18e4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040221 Apr 13 20:14:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 20:14:43 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001276 Apr 13 20:14:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-5f51f453-f246-4b05-a90c-53a079e0a4d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-5f51f453-f246-4b05-a90c-53a079e0a4d8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075948 Apr 13 20:14:45 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:45 2023] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:45 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-0a4d999c-d101-4a6b-9619-d1d5648e46bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-0a4d999c-d101-4a6b-9619-d1d5648e46bb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029482 Apr 13 20:14:45 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 20:14:45 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:47 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:47 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001298 Apr 13 20:14:47 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:47 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ac056bdc-2d5f-4369-8831-3a448861d2ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-ac056bdc-2d5f-4369-8831-3a448861d2ee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058099 Apr 13 20:14:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:47 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8c97d94f-eaf6-401c-9a96-eb74553c3a59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-8c97d94f-eaf6-401c-9a96-eb74553c3a59 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023898 Apr 13 20:14:47 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 20:14:47 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001400 Apr 13 20:14:49 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:49 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c254cc0d-bd05-499f-8556-5e3425912458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c254cc0d-bd05-499f-8556-5e3425912458 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079072 Apr 13 20:14:49 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:49 2023] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023551 Apr 13 20:14:49 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 20:14:49 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:51 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-31058353-42b2-4d75-98b6-daa43073e15b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001589 Apr 13 20:14:51 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:51 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6c0b8f1a-ae0f-4b0f-93e2-e14b511b75aa admin admin] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:51 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6c0b8f1a-ae0f-4b0f-93e2-e14b511b75aa admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.072132 Apr 13 20:14:51 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 20:14:51 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:14:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001593 Apr 13 20:14:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:53 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:53 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:53 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:53 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:14:53 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-cb2a3b68-cd4f-47f6-8b35-35340e04c6d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "id": "1", "vcpus": 1, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-cb2a3b68-cd4f-47f6-8b35-35340e04c6d8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.334154 Apr 13 20:14:53 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:53 2023] POST /compute/v2.1/flavors => generated 400 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-666e824f-2b33-4aeb-94f3-8461cd88e74e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-666e824f-2b33-4aeb-94f3-8461cd88e74e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039494 Apr 13 20:14:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 20:14:53 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001597 Apr 13 20:14:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b3a19077-2b74-4aad-b757-95dd014e2b98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "id": "2", "disk": 20, "rxtx_factor": 1.0}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b3a19077-2b74-4aad-b757-95dd014e2b98 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.056847 Apr 13 20:14:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:55 2023] POST /compute/v2.1/flavors => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:55 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c39eebd0-8636-4f7b-8fb3-79cb63673679 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:55 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c39eebd0-8636-4f7b-8fb3-79cb63673679 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027559 Apr 13 20:14:55 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 20:14:55 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:57 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001419 Apr 13 20:14:57 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-9be59a58-ffbd-4ca5-aa03-9f1a2e531654 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "vcpus": 2}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-9be59a58-ffbd-4ca5-aa03-9f1a2e531654 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.062727 Apr 13 20:14:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:57 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:57 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b336de10-6f59-4cea-a896-bedff7365f9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b336de10-6f59-4cea-a896-bedff7365f9e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026327 Apr 13 20:14:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 20:14:57 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:14:59 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:14:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002404 Apr 13 20:14:59 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:14:59 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:14:59 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d8f80c6f-24d7-4254-9837-1a2c4a3c91b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "id": "4", "rxtx_factor": 1.0, "ram": 8192}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d8f80c6f-24d7-4254-9837-1a2c4a3c91b4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.069237 Apr 13 20:14:59 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:14:59 2023] POST /compute/v2.1/flavors => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:14:59 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c87d15d0-4010-48a9-ac8a-d9af72ae1449 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:14:59 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c87d15d0-4010-48a9-ac8a-d9af72ae1449 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026884 Apr 13 20:14:59 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 20:14:59 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:15:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:15:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001512 Apr 13 20:15:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 20:15:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:15:01 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-15b60e3e-7618-4484-aa6e-e2dc3595ef53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "id": "5"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:15:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-15b60e3e-7618-4484-aa6e-e2dc3595ef53 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.059307 Apr 13 20:15:01 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 20:15:01 2023] POST /compute/v2.1/flavors => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:15:01 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a1fcfe59-595a-4844-b3ce-ebeab4f33e87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:15:01 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a1fcfe59-595a-4844-b3ce-ebeab4f33e87 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024048 Apr 13 20:15:01 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 20:15:01 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:15:32 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:15:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7c760dcb-21b6-444b-aa2d-6ec7e1ce339c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001422 Apr 13 20:15:32 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 20:15:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:15:32 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:15:32 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:15:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:15:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:15:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:15:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:15:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:15:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:15:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.100528 Apr 13 20:15:32 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 13 20:15:32 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:16:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a1fcfe59-595a-4844-b3ce-ebeab4f33e87 admin admin] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:16:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a1fcfe59-595a-4844-b3ce-ebeab4f33e87 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001530 Apr 13 20:16:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 20:16:04 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:16:04 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:16:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2e57a38a-dee5-48fc-a9d1-1971ac1e95ff admin admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:16:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2e57a38a-dee5-48fc-a9d1-1971ac1e95ff admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.064896 Apr 13 20:16:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 13 20:16:04 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:16:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:16:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002512 Apr 13 20:16:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 20:16:09 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:16:09 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:16:09 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-5e32508a-0e4c-4b00-8fd4-2bed6b2ecfd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "42", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "name": "m1.nano", "ram": 128}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:16:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-5e32508a-0e4c-4b00-8fd4-2bed6b2ecfd5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067354 Apr 13 20:16:09 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 20:16:09 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:16:09 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-68b98c32-ba45-4e38-a718-8c1b7d209d03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:16:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-68b98c32-ba45-4e38-a718-8c1b7d209d03 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025101 Apr 13 20:16:09 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 20:16:09 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:16:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:16:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6fb37807-9afe-42b2-bcdf-2f7af87b579f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001362 Apr 13 20:16:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 20:16:13 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:16:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0522c91e-efe8-4e0f-bec5-d222b342a17f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.micro", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "id": "84"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:16:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0522c91e-efe8-4e0f-bec5-d222b342a17f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063371 Apr 13 20:16:13 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 20:16:13 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:16:13 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-21a92f97-efd0-4ea5-a929-d37d28719b5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:16:13 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-21a92f97-efd0-4ea5-a929-d37d28719b5d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023321 Apr 13 20:16:13 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 20:16:13 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:18:40 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:18:40 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:18:40 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:18:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-99d9ff00-f893-43bf-85e8-e79b8e344654 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Action: 'create', calling method: .version_select at 0x7f7838e0e680>, body: {"keypair": {"name": "tempest-keypair-1968906009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq1U5QECB3FwD62l+VoD4RcrdT4EaNcIQSWZpqPdFG+5sUJl6aJ5L9iAijKA5SZiYUs+UXX2i0SuapMZsoqaM+jDDv+ifTc3jkJuvkYwnliPrzr/xR1kynUx8tBW306ag=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:18:40 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-99d9ff00-f893-43bf-85e8-e79b8e344654 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Getting quotas for project 4c3042be539b4749b37156c0e5a9d907. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:18:40 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-99d9ff00-f893-43bf-85e8-e79b8e344654 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Getting quotas for user 5cb2df6092c342e0b0f44c37abb4a88a and project 4c3042be539b4749b37156c0e5a9d907. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:18:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-99d9ff00-f893-43bf-85e8-e79b8e344654 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.289862 Apr 13 20:18:40 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:18:40 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:18:47 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:18:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-fbb51ec0-7899-416c-8eea-cc35e38a7f23 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'create', calling method: .version_select at 0x7f7838f93490>, body: {"keypair": {"name": "tempest-keypair-1146136459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOQLEfnUAdwXiipQWQC6KVFeB1qTwUX2x1/w1l3Smwk+oocpgJJtYwCafCK7wWtX/jdQXFNg9495lZCIwIq0anujj/KJcgFvWh54vZk//EcBX7yDONmBSz2eGEsOBPB1w=="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:18:47 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-fbb51ec0-7899-416c-8eea-cc35e38a7f23 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting quotas for project 405aed9fca044ab39eabe188942230d2. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:18:47 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-fbb51ec0-7899-416c-8eea-cc35e38a7f23 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting quotas for user 36e11efc98604eb7a8d5b95563431e45 and project 405aed9fca044ab39eabe188942230d2. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:18:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-fbb51ec0-7899-416c-8eea-cc35e38a7f23 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.505986 Apr 13 20:18:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 17/47] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 20:18:47 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 508 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 20:18:49 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:18:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-348825334", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "9bff1def-38cf-4052-af77-c43c1b79af0a"}], "security_groups": [{"name": "tempest-securitygroup--1077757388"}], "key_name": "tempest-keypair-1968906009", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:18:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-763294771", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:18:49 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] validate_networks() for [('9bff1def-38cf-4052-af77-c43c1b79af0a', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:18:50 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] validate_networks() for [('398c479c-fb42-41ad-8dbc-ee2b84e9fa05', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:18:50 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Getting quotas for project 4c3042be539b4749b37156c0e5a9d907. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Getting quotas for user 5cb2df6092c342e0b0f44c37abb4a88a and project 4c3042be539b4749b37156c0e5a9d907. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:18:51 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:18:51 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.272485 Apr 13 20:18:51 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:18:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:18:51 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-fb1d1dae-3ce3-4855-8bb1-4a2db841b10b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:18:51 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-fb1d1dae-3ce3-4855-8bb1-4a2db841b10b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:18:51 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-fb1d1dae-3ce3-4855-8bb1-4a2db841b10b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb2df6092c342e0b0f44c37abb4a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3042be539b4749b37156c0e5a9d907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:18:51 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-fb1d1dae-3ce3-4855-8bb1-4a2db841b10b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 200 len: 1239 microversion: 2.1 time: 0.336073 Apr 13 20:18:51 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 18/49] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:18:51 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 1239 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Getting quotas for project da6301bd811748429fd4bc6b1205e07d. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Getting quotas for user b50309fc4b92451f8cc40e92b10861ba and project da6301bd811748429fd4bc6b1205e07d. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:18:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:18:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.902357 Apr 13 20:18:52 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 16/50] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:18:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 2904 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:18:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-cd72452a-9f12-41c3-9b1e-d913aeaf9cb5 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:18:52 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-cd72452a-9f12-41c3-9b1e-d913aeaf9cb5 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:18:52 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-cd72452a-9f12-41c3-9b1e-d913aeaf9cb5 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50309fc4b92451f8cc40e92b10861ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6301bd811748429fd4bc6b1205e07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:18:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-cd72452a-9f12-41c3-9b1e-d913aeaf9cb5 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10" status: 200 len: 1208 microversion: 2.1 time: 0.217679 Apr 13 20:18:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:18:52 2023] GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => generated 1208 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:18:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2122692990", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc"}], "security_groups": [{"name": "tempest-securitygroup--711151138"}], "key_name": "tempest-keypair-1146136459", "user_data": "}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:18:54 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] validate_networks() for [('c8b2ab21-23b9-4644-b252-4cd4bd700fbc', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting quotas for project 405aed9fca044ab39eabe188942230d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting quotas for user 36e11efc98604eb7a8d5b95563431e45 and project 405aed9fca044ab39eabe188942230d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:18:55 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:18:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 2.274995 Apr 13 20:18:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 19/52] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 20:18:53 2023] POST /compute/v2.1/servers => generated 399 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 20:18:56 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-75818a31-602c-4c06-93cf-3408cd9d3c30 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:18:56 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-75818a31-602c-4c06-93cf-3408cd9d3c30 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:18:56 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-75818a31-602c-4c06-93cf-3408cd9d3c30 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:18:56 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-75818a31-602c-4c06-93cf-3408cd9d3c30 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:18:56 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-75818a31-602c-4c06-93cf-3408cd9d3c30 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:18:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-75818a31-602c-4c06-93cf-3408cd9d3c30 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 200 len: 1276 microversion: 2.20 time: 0.235593 Apr 13 20:18:56 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 17/53] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:18:56 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Creating event network-changed:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:58 user devstack@n-api.service[61654]: INFO nova.compute.rpcapi [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 20:18:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] Releasing lock "compute-rpcapi-router" {{(pid=61654) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 20:18:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7367187c-dead-4ca2-8f5f-7f77a1869b0a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169494 Apr 13 20:18:58 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 18/54] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:18:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6fde0f5-70fc-49a5-96f9-b67ed1662a10", "tag": "647040e8-c10a-43ef-ae04-6be7319fae12"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:59 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Creating event network-changed:647040e8-c10a-43ef-ae04-6be7319fae12 for instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 on user Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61653) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61653) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:18:59 user devstack@n-api.service[61653]: INFO nova.compute.rpcapi [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 20:18:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] Releasing lock "compute-rpcapi-router" {{(pid=61653) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 20:18:59 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-78cef743-59a0-4dff-89c0-4a12eda52d33 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271463 Apr 13 20:18:59 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 20/55] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:18:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:03 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:03 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d08c8652-8fb2-4f11-b69e-72f9c05d4691 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Action: 'create', calling method: .version_select at 0x7f7838d68820>, body: {"keypair": {"name": "tempest-keypair-2052829447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMR5psfAcnJlKjT/RtzaTkF3/qOYyDj5Xn6kIK/NUuAwGleXA15sRvKayZlO18tYgwanamPIT8ZggDbnda9sBlIc1tFLCti7muSZvOgdDdZfdJxmASXXhL821fWkXkfIg=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:04 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-d08c8652-8fb2-4f11-b69e-72f9c05d4691 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting quotas for project 41ed651e141447b995ccae680f1f3681. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:04 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-d08c8652-8fb2-4f11-b69e-72f9c05d4691 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting quotas for user 7cbfa14567af452db21cb0022514773b and project 41ed651e141447b995ccae680f1f3681. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d08c8652-8fb2-4f11-b69e-72f9c05d4691 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.254654 Apr 13 20:19:04 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 18/56] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:19:03 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:04 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] Creating event network-changed:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:19:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055926 Apr 13 20:19:05 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 19/57] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:07 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=12 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1689071346", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "0307f481-3bd2-4735-bebd-a8e4fe253c1e"}], "security_groups": [{"name": "tempest-securitygroup--1980824192"}], "key_name": "tempest-keypair-2052829447", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:07 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] validate_networks() for [('0307f481-3bd2-4735-bebd-a8e4fe253c1e', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:09 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting quotas for project 41ed651e141447b995ccae680f1f3681. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:09 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting quotas for user 7cbfa14567af452db21cb0022514773b and project 41ed651e141447b995ccae680f1f3681. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:09 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:19:09 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:19:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.914310 Apr 13 20:19:09 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 21/58] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:19:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 20:19:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a609248b-b409-4eb3-adfa-0f745225a561 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:09 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a609248b-b409-4eb3-adfa-0f745225a561 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:09 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-a609248b-b409-4eb3-adfa-0f745225a561 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cbfa14567af452db21cb0022514773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed651e141447b995ccae680f1f3681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:09 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-plugged", "status": "completed", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a609248b-b409-4eb3-adfa-0f745225a561 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b" status: 200 len: 1236 microversion: 2.1 time: 0.195645 Apr 13 20:19:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 19/59] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:19:09 2023] GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b => generated 1236 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:19:09 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] Creating event network-vif-plugged:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:19:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054343 Apr 13 20:19:09 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:09 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fde0f5-70fc-49a5-96f9-b67ed1662a10", "name": "network-vif-plugged", "status": "completed", "tag": "647040e8-c10a-43ef-ae04-6be7319fae12"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] Creating event network-vif-plugged:647040e8-c10a-43ef-ae04-6be7319fae12 for instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 on user Apr 13 20:19:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064758 Apr 13 20:19:09 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 22/61] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8a48021e-ecf9-4d31-b1a7-fbad73cd9cd3 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Action: 'create', calling method: .version_select at 0x7f7838d68dc0>, body: {"keypair": {"name": "tempest-keypair-1666630945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrwrPfleyNjl3pDB5OkN2SYvDCZ013r8+oGp8DrB4SN27ompGWdOkKmSpJhoB5cQCLOWrXxLcw6gtj75RcWJZ4DWqDRz9J0aW7xIy1OvV2R0hIUpHmgCErOlVkccauWWg=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:09 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-8a48021e-ecf9-4d31-b1a7-fbad73cd9cd3 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Getting quotas for project 49944b378c2b4e618a631771465a4a9b. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:10 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-8a48021e-ecf9-4d31-b1a7-fbad73cd9cd3 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Getting quotas for user 195c6c0bc1ec4796b5c1e2ba88c7534a and project 49944b378c2b4e618a631771465a4a9b. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8a48021e-ecf9-4d31-b1a7-fbad73cd9cd3 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098083 Apr 13 20:19:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 20/62] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:19:09 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:11 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-plugged", "status": "completed", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] Creating event network-vif-plugged:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:19:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066453 Apr 13 20:19:11 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fde0f5-70fc-49a5-96f9-b67ed1662a10", "name": "network-vif-plugged", "status": "completed", "tag": "647040e8-c10a-43ef-ae04-6be7319fae12"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] Creating event network-vif-plugged:647040e8-c10a-43ef-ae04-6be7319fae12 for instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 on user Apr 13 20:19:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056823 Apr 13 20:19:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 23/64] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}, {"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:19:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61655) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61655) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:14 user devstack@n-api.service[61655]: INFO nova.compute.rpcapi [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 20:19:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=61655) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 20:19:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-9c2c76b3-64d2-4591-9325-98c9ae1c98e8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.130881 Apr 13 20:19:14 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-0c939b03-0286-42be-b5fc-87ebe514cf52 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Action: 'create', calling method: .version_select at 0x7f7838ef9cf0>, body: {"keypair": {"name": "tempest-keypair-964773546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUdmP1CY8bdTh8IXDrsiI4+sMDfwgwwFraKNk8459+0r49Q9ABneRe4MPsuQ/EiitrvDfvuzfptfBBU8iwJnxppZYB6l8MvGtaZ90NTqGXOPbE8oGQStKt+DK5t1pV+Hg=="}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:16 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-0c939b03-0286-42be-b5fc-87ebe514cf52 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Getting quotas for project a2fff2eec2af433e9699cbc5be23e80e. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:16 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-0c939b03-0286-42be-b5fc-87ebe514cf52 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Getting quotas for user 02540e30946f4e5c844c1e8f260e4728 and project a2fff2eec2af433e9699cbc5be23e80e. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:17 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-0c939b03-0286-42be-b5fc-87ebe514cf52 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.411755 Apr 13 20:19:17 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 22/66] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:19:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:17 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0136288f-abaf-4a7c-a878-db415ff98f4b", "tag": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:17 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:17 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1482198801", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a"}], "security_groups": [{"name": "tempest-securitygroup--287545320"}], "key_name": "tempest-keypair-1666630945", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:17 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=13 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:17 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] Creating event network-changed:11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance 0136288f-abaf-4a7c-a878-db415ff98f4b on user Apr 13 20:19:17 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114516 Apr 13 20:19:17 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 24/67] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:17 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] validate_networks() for [('3036b30e-22ce-48cd-a4f0-1e9b60c0af5a', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Getting quotas for project 49944b378c2b4e618a631771465a4a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Getting quotas for user 195c6c0bc1ec4796b5c1e2ba88c7534a and project 49944b378c2b4e618a631771465a4a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:19:18 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:19:18 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.789968 Apr 13 20:19:18 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 22/68] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:19:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:19:19 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-95e9b11f-aa89-441f-a297-c2e5960e5c02 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:19 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-95e9b11f-aa89-441f-a297-c2e5960e5c02 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:19 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-95e9b11f-aa89-441f-a297-c2e5960e5c02 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195c6c0bc1ec4796b5c1e2ba88c7534a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49944b378c2b4e618a631771465a4a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-95e9b11f-aa89-441f-a297-c2e5960e5c02 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc" status: 200 len: 1226 microversion: 2.1 time: 0.121960 Apr 13 20:19:19 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 23/69] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:19:19 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc => generated 1226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:19:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:20 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0136288f-abaf-4a7c-a878-db415ff98f4b", "name": "network-vif-plugged", "status": "completed", "tag": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] Creating event network-vif-plugged:11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance 0136288f-abaf-4a7c-a878-db415ff98f4b on user Apr 13 20:19:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136872 Apr 13 20:19:20 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 25/70] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:20 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-569327851", "imageRef": "f1c9d799-549d-45fe-975d-6271934a1df9", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3e979e57-12db-42a3-95d7-aa85f8c622da"}], "security_groups": [{"name": "tempest-securitygroup--188599052"}], "key_name": "tempest-keypair-964773546", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:20 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] validate_networks() for [('3e979e57-12db-42a3-95d7-aa85f8c622da', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:19:21 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-5ce3a038-2943-4953-be5d-800c771594e5 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Action: 'create', calling method: .version_select at 0x7f7838ef9e10>, body: {"keypair": {"name": "tempest-keypair-407107657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg=="}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:21 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:19:21 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-5ce3a038-2943-4953-be5d-800c771594e5 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Getting quotas for project 10892937e6784f7bab0a6e5d835f9009. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:21 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-5ce3a038-2943-4953-be5d-800c771594e5 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Getting quotas for user 4274e07dcb15438689444331f895ca18 and project 10892937e6784f7bab0a6e5d835f9009. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=25 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:21 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-5ce3a038-2943-4953-be5d-800c771594e5 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.052357 Apr 13 20:19:21 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 24/71] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 20:19:21 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Getting quotas for project a2fff2eec2af433e9699cbc5be23e80e. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Getting quotas for user 02540e30946f4e5c844c1e8f260e4728 and project a2fff2eec2af433e9699cbc5be23e80e. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:19:21 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f1c9d799-549d-45fe-975d-6271934a1df9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:19:21 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.000877 Apr 13 20:19:21 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 23/72] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:19:20 2023] POST /compute/v2.1/servers => generated 403 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:19:21 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4e5efd0f-7cb5-4585-b123-75a61c7c3ceb tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:21 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4e5efd0f-7cb5-4585-b123-75a61c7c3ceb tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:21 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-4e5efd0f-7cb5-4585-b123-75a61c7c3ceb tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02540e30946f4e5c844c1e8f260e4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fff2eec2af433e9699cbc5be23e80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:21 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4e5efd0f-7cb5-4585-b123-75a61c7c3ceb tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73" status: 200 len: 1238 microversion: 2.1 time: 0.111976 Apr 13 20:19:21 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 26/73] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:19:21 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 => generated 1238 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:19:22 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=12 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0136288f-abaf-4a7c-a878-db415ff98f4b", "name": "network-vif-plugged", "status": "completed", "tag": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] Creating event network-vif-plugged:11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance 0136288f-abaf-4a7c-a878-db415ff98f4b on user Apr 13 20:19:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071735 Apr 13 20:19:22 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:23 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da17669c-1ea2-450a-8183-40b47c4f41fc", "tag": "3e161dc0-b110-47f1-9a0a-f9add33a394b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] Creating event network-changed:3e161dc0-b110-47f1-9a0a-f9add33a394b for instance da17669c-1ea2-450a-8183-40b47c4f41fc on user Apr 13 20:19:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034103 Apr 13 20:19:23 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 24/75] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-524065510", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "cace8c06-4171-49b3-bc24-faaa03dc8a09"}], "security_groups": [{"name": "tempest-securitygroup--2082703965"}], "key_name": "tempest-keypair-407107657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:24 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] validate_networks() for [('cace8c06-4171-49b3-bc24-faaa03dc8a09', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Getting quotas for project 10892937e6784f7bab0a6e5d835f9009. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Getting quotas for user 4274e07dcb15438689444331f895ca18 and project 10892937e6784f7bab0a6e5d835f9009. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:19:25 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:19:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.723576 Apr 13 20:19:25 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 27/76] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 20:19:24 2023] POST /compute/v2.1/servers => generated 404 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 20:19:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-0d900b0d-f57c-4ead-b326-170fe334c8b4 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:25 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-0d900b0d-f57c-4ead-b326-170fe334c8b4 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:25 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-0d900b0d-f57c-4ead-b326-170fe334c8b4 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:25 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-0d900b0d-f57c-4ead-b326-170fe334c8b4 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:25 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-0d900b0d-f57c-4ead-b326-170fe334c8b4 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-0d900b0d-f57c-4ead-b326-170fe334c8b4 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f" status: 200 len: 1319 microversion: 2.49 time: 0.088872 Apr 13 20:19:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 26/77] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:19:25 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f => generated 1319 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:19:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936eb14-b16e-46fb-9e39-5ba49da4fb73", "tag": "80e7738a-fc24-4b82-b70b-ae85ea74545f"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] Creating event network-changed:80e7738a-fc24-4b82-b70b-ae85ea74545f for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 on user Apr 13 20:19:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060163 Apr 13 20:19:26 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 25/78] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:28 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da17669c-1ea2-450a-8183-40b47c4f41fc", "name": "network-vif-plugged", "status": "completed", "tag": "3e161dc0-b110-47f1-9a0a-f9add33a394b"}, {"server_uuid": "da17669c-1ea2-450a-8183-40b47c4f41fc", "name": "network-vif-plugged", "status": "completed", "tag": "3e161dc0-b110-47f1-9a0a-f9add33a394b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:28 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Creating event network-vif-plugged:3e161dc0-b110-47f1-9a0a-f9add33a394b for instance da17669c-1ea2-450a-8183-40b47c4f41fc on user Apr 13 20:19:28 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Creating event network-vif-plugged:3e161dc0-b110-47f1-9a0a-f9add33a394b for instance da17669c-1ea2-450a-8183-40b47c4f41fc on user Apr 13 20:19:28 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036086 Apr 13 20:19:28 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 28/79] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936eb14-b16e-46fb-9e39-5ba49da4fb73", "name": "network-vif-plugged", "status": "completed", "tag": "80e7738a-fc24-4b82-b70b-ae85ea74545f"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] Creating event network-vif-plugged:80e7738a-fc24-4b82-b70b-ae85ea74545f for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 on user Apr 13 20:19:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 Apr 13 20:19:29 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 27/80] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "tag": "3ac07688-57a6-45c2-9b2c-eea32bc1e446"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:30 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] Creating event network-changed:3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:19:30 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042878 Apr 13 20:19:30 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 26/81] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:31 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936eb14-b16e-46fb-9e39-5ba49da4fb73", "name": "network-vif-plugged", "status": "completed", "tag": "80e7738a-fc24-4b82-b70b-ae85ea74545f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] Creating event network-vif-plugged:80e7738a-fc24-4b82-b70b-ae85ea74545f for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 on user Apr 13 20:19:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062696 Apr 13 20:19:31 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 29/82] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:33 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-plugged", "status": "completed", "tag": "3ac07688-57a6-45c2-9b2c-eea32bc1e446"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] Creating event network-vif-plugged:3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:19:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073784 Apr 13 20:19:33 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:35 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:35 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=5 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:35 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-plugged", "status": "completed", "tag": "3ac07688-57a6-45c2-9b2c-eea32bc1e446"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:35 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] Creating event network-vif-plugged:3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:19:35 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068592 Apr 13 20:19:35 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 27/84] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=9 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:42 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb2df6092c342e0b0f44c37abb4a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3042be539b4749b37156c0e5a9d907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8e5b8031-0263-419e-9ffe-2c7c28a2c054 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 200 len: 1553 microversion: 2.1 time: 0.401893 Apr 13 20:19:42 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 30/85] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:19:41 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 1553 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=12 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:42 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50309fc4b92451f8cc40e92b10861ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6301bd811748429fd4bc6b1205e07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e030fed3-07db-4754-bc27-7945c6e1606a tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10" status: 200 len: 1489 microversion: 2.1 time: 0.291598 Apr 13 20:19:42 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 29/86] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:19:42 2023] GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => generated 1489 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:19:45 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:45 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=16 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-bc3abf26-de0b-42b2-9d1a-8c0db1b63285 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Action: 'create', calling method: .version_select at 0x7f7838d70790>, body: {"keypair": {"name": "tempest-keypair-187606045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:45 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-bc3abf26-de0b-42b2-9d1a-8c0db1b63285 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Getting quotas for project 9ced32cd96594324b6b8792ef56e28c5. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:45 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-bc3abf26-de0b-42b2-9d1a-8c0db1b63285 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Getting quotas for user 1dc7db2b4cb64d2e9ad08692b248bb18 and project 9ced32cd96594324b6b8792ef56e28c5. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-bc3abf26-de0b-42b2-9d1a-8c0db1b63285 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.092645 Apr 13 20:19:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 28/87] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 20:19:45 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:46 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4c7d2997-65ef-45ca-ae03-2f6799d5fd39 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 200 len: 1587 microversion: 2.20 time: 0.235141 Apr 13 20:19:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 31/88] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:19:46 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 1587 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:19:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1152408138", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "17186205-53ed-4e04-8d16-ac48ae498058"}, {"port": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "tag": "port-1"}, {"port": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "tag": "port-2"}, {"uuid": "a081e803-ef34-4744-8355-532db29d9e29", "tag": "net-1"}, {"uuid": "a081e803-ef34-4744-8355-532db29d9e29"}, {"uuid": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b2979586-cf14-4797-b906-547f3363090c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ce955f5a-7ac3-40f7-ac14-f9c88130ab05", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "88153816-fae2-4266-8f74-c06985cbe41c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2060289841"}], "key_name": "tempest-keypair-187606045", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:47 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] validate_networks() for [('17186205-53ed-4e04-8d16-ac48ae498058', None, None, None, None, None), (None, None, '58a1b4af-7470-4cef-8c7a-7e611f8942fb', None, None, None), (None, None, '51a691d6-af80-4126-9fa3-99fd3ee39a9d', None, None, None), ('a081e803-ef34-4744-8355-532db29d9e29', None, None, None, None, None), ('a081e803-ef34-4744-8355-532db29d9e29', None, None, None, None, None), ('8e5e046b-8f60-4247-9c4e-cec1d1352bd2', '10.2.2.100', None, None, None, None), ('8e5e046b-8f60-4247-9c4e-cec1d1352bd2', '10.2.2.200', None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:19:48 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-86a2139b-e62a-4c94-9fbe-825bfeb8c7d8 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Action: 'create', calling method: .version_select at 0x7f7838d68dc0>, body: {"keypair": {"name": "tempest-keypair-1712483657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:48 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-86a2139b-e62a-4c94-9fbe-825bfeb8c7d8 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Getting quotas for project e01e2122799d4cfe81a642146f5c1421. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:48 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-86a2139b-e62a-4c94-9fbe-825bfeb8c7d8 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Getting quotas for user 5a2f99d6d3ee4f1b968dcc6ed6fccb84 and project e01e2122799d4cfe81a642146f5c1421. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:48 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-86a2139b-e62a-4c94-9fbe-825bfeb8c7d8 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.102783 Apr 13 20:19:48 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 29/89] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 20:19:48 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Getting quotas for project 9ced32cd96594324b6b8792ef56e28c5. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Getting quotas for user 1dc7db2b4cb64d2e9ad08692b248bb18 and project 9ced32cd96594324b6b8792ef56e28c5. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:50 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-194894390", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a0f78602-1e31-4d8f-ac87-4a19cd056029"}, {"port": "cd297158-7c28-4e96-9055-7547d626d066", "tag": "port-1"}, {"port": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "tag": "port-2"}, {"uuid": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "tag": "net-1"}, {"uuid": "0d05e3f4-7201-4c56-bf77-f842e674c5f4"}, {"uuid": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "09705428-be59-4d47-8c48-3f7a0d94963a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f494b4ba-5741-4d3f-8eb1-b5ff89f54337", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "400b6a69-9110-481d-89de-b9a4dad69bfa", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1270180980"}], "key_name": "tempest-keypair-1712483657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:19:50 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b2979586-cf14-4797-b906-547f3363090c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ce955f5a-7ac3-40f7-ac14-f9c88130ab05',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88153816-fae2-4266-8f74-c06985cbe41c',volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:19:50 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] validate_networks() for [('a0f78602-1e31-4d8f-ac87-4a19cd056029', None, None, None, None, None), (None, None, 'cd297158-7c28-4e96-9055-7547d626d066', None, None, None), (None, None, '4e89cf33-c25a-42d7-be8d-bfeeea25e607', None, None, None), ('0d05e3f4-7201-4c56-bf77-f842e674c5f4', None, None, None, None, None), ('0d05e3f4-7201-4c56-bf77-f842e674c5f4', None, None, None, None, None), ('a5ebc511-c961-4ab1-8620-c595a9c8fbdb', '10.2.2.100', None, None, None, None), ('a5ebc511-c961-4ab1-8620-c595a9c8fbdb', '10.2.2.200', None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:19:50 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.135641 Apr 13 20:19:50 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 30/90] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 20:19:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 20:19:50 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-080a98d7-54ec-4654-b44a-fd4f69a42842 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:50 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-080a98d7-54ec-4654-b44a-fd4f69a42842 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:51 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-080a98d7-54ec-4654-b44a-fd4f69a42842 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:51 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-080a98d7-54ec-4654-b44a-fd4f69a42842 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:51 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-080a98d7-54ec-4654-b44a-fd4f69a42842 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-080a98d7-54ec-4654-b44a-fd4f69a42842 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 200 len: 1279 microversion: 2.32 time: 0.120086 Apr 13 20:19:51 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 30/91] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:19:50 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Getting quotas for project e01e2122799d4cfe81a642146f5c1421. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Getting quotas for user 5a2f99d6d3ee4f1b968dcc6ed6fccb84 and project e01e2122799d4cfe81a642146f5c1421. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:19:52 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='09705428-be59-4d47-8c48-3f7a0d94963a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f494b4ba-5741-4d3f-8eb1-b5ff89f54337',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='400b6a69-9110-481d-89de-b9a4dad69bfa',volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:19:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 2.755085 Apr 13 20:19:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 32/92] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 20:19:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 20:19:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a5b970d9-a4a9-48e7-ba36-94ebba880f64 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:53 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a5b970d9-a4a9-48e7-ba36-94ebba880f64 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:53 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:19:53 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-a5b970d9-a4a9-48e7-ba36-94ebba880f64 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:53 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-a5b970d9-a4a9-48e7-ba36-94ebba880f64 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:53 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-a5b970d9-a4a9-48e7-ba36-94ebba880f64 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a5b970d9-a4a9-48e7-ba36-94ebba880f64 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" status: 200 len: 1279 microversion: 2.42 time: 0.133147 Apr 13 20:19:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 31/93] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:19:53 2023] GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => generated 1279 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:19:59 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "tag": "b2c1c646-b65c-4543-bf25-b89ff954fdd1"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:19:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:19:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] Creating event network-changed:b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:19:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074531 Apr 13 20:19:59 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:19:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:19:59 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cbfa14567af452db21cb0022514773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed651e141447b995ccae680f1f3681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:19:59 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-59c59797-cfd5-4b1a-922b-c80019ede2a6 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b" status: 200 len: 1545 microversion: 2.1 time: 0.185563 Apr 13 20:19:59 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 33/95] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:19:59 2023] GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b => generated 1545 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:20:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "tag": "58a1b4af-7470-4cef-8c7a-7e611f8942fb"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:01 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:01 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=14 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] Creating event network-changed:58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039285 Apr 13 20:20:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:03 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=10 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:03 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "tag": "51a691d6-af80-4126-9fa3-99fd3ee39a9d"}, {"name": "network-changed", "server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "tag": "8a43e7e1-8da0-48b7-a18d-8899539118c7"}, {"name": "network-changed", "server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "tag": "0fc22c68-14c3-4803-952d-32dac032db89"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Creating event network-changed:51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Creating event network-changed:8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Creating event network-changed:0fc22c68-14c3-4803-952d-32dac032db89 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.052237 Apr 13 20:20:03 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:03 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:05 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "tag": "ee2ced5f-3757-4527-a93f-72d920a58291"}, {"name": "network-changed", "server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "tag": "cd297158-7c28-4e96-9055-7547d626d066"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:05 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:05 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:05 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Creating event network-changed:ee2ced5f-3757-4527-a93f-72d920a58291 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:05 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Creating event network-changed:cd297158-7c28-4e96-9055-7547d626d066 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:05 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043163 Apr 13 20:20:05 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:05 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:07 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:07 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "tag": "b3deaefd-62cd-4147-b744-783c9f5ff678"}, {"name": "network-changed", "server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "tag": "4e89cf33-c25a-42d7-be8d-bfeeea25e607"}, {"name": "network-changed", "server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "tag": "68c624f1-a380-4397-b311-6104fad344a8"}, {"name": "network-changed", "server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "tag": "32e1b953-1235-44ba-918c-ff264b484629"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Creating event network-changed:b3deaefd-62cd-4147-b744-783c9f5ff678 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Creating event network-changed:4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Creating event network-changed:68c624f1-a380-4397-b311-6104fad344a8 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Creating event network-changed:32e1b953-1235-44ba-918c-ff264b484629 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.037142 Apr 13 20:20:07 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:07 2023] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:09 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195c6c0bc1ec4796b5c1e2ba88c7534a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49944b378c2b4e618a631771465a4a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-db26d10e-f33a-469a-95f1-5451f099c869 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc" status: 200 len: 1525 microversion: 2.1 time: 0.258833 Apr 13 20:20:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 33/100] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:20:09 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc => generated 1525 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:20:09 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "tag": "12991ac8-5935-4b35-918a-015677766ea7"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] Creating event network-changed:12991ac8-5935-4b35-918a-015677766ea7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036006 Apr 13 20:20:09 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:11 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "tag": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] Creating event network-changed:b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032020 Apr 13 20:20:11 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:11 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:11 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:11 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "tag": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:11 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:11 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=25 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] Creating event network-changed:1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038880 Apr 13 20:20:11 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 36/103] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:12 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02540e30946f4e5c844c1e8f260e4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fff2eec2af433e9699cbc5be23e80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:12 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-5f0ab690-98b0-4f49-b052-091b9fd524bc tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73" status: 200 len: 1547 microversion: 2.1 time: 0.140715 Apr 13 20:20:12 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 34/104] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:20:11 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 => generated 1547 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:15 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-cf270726-5294-4a58-9ee0-e88189705c4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f" status: 200 len: 1625 microversion: 2.49 time: 0.331450 Apr 13 20:20:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 35/105] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:20:15 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f => generated 1625 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:20:30 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:30 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "8a43e7e1-8da0-48b7-a18d-8899539118c7"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] Creating event network-vif-plugged:8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051608 Apr 13 20:20:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 37/106] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "cd297158-7c28-4e96-9055-7547d626d066"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:30 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:30 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=16 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:30 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] Creating event network-vif-plugged:cd297158-7c28-4e96-9055-7547d626d066 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:30 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035830 Apr 13 20:20:30 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 35/107] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:31 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "32e1b953-1235-44ba-918c-ff264b484629"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:31 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=11 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:31 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=12 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:31 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] Creating event network-vif-plugged:32e1b953-1235-44ba-918c-ff264b484629 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:31 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034515 Apr 13 20:20:31 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 36/108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:32 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "8a43e7e1-8da0-48b7-a18d-8899539118c7"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "4e89cf33-c25a-42d7-be8d-bfeeea25e607"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "4e89cf33-c25a-42d7-be8d-bfeeea25e607"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Creating event network-vif-plugged:8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Creating event network-vif-plugged:4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Creating event network-vif-plugged:4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Creating event network-vif-plugged:1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.065257 Apr 13 20:20:32 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 38/109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:32 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "cd297158-7c28-4e96-9055-7547d626d066"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] Creating event network-vif-plugged:cd297158-7c28-4e96-9055-7547d626d066 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:33 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067404 Apr 13 20:20:33 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:33 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "32e1b953-1235-44ba-918c-ff264b484629"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "12991ac8-5935-4b35-918a-015677766ea7"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "12991ac8-5935-4b35-918a-015677766ea7"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Creating event network-vif-plugged:32e1b953-1235-44ba-918c-ff264b484629 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Creating event network-vif-plugged:12991ac8-5935-4b35-918a-015677766ea7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Creating event network-vif-plugged:12991ac8-5935-4b35-918a-015677766ea7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072609 Apr 13 20:20:33 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 37/111] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:33 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Creating event network-vif-plugged:1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Creating event network-vif-plugged:b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Creating event network-vif-plugged:b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:20:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038537 Apr 13 20:20:34 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 39/112] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:34 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-757898920", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] validate_networks() for None {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:20:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e2c0a26b-13d1-463d-be55-9b61e799b366 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Action: 'create', calling method: .version_select at 0x7f7838d70040>, body: {"keypair": {"name": "tempest-TestStampPattern-1904080569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUQBh930yqIsWrBpzChPqUfFp84iq6xAXnNoODiDjwhy0hNv3njy7LifFS5jQw8IWaidr5Dh/6719yRbd7zDLecV87ml5BsrcFT0GxFC5jbzM3qXODNWUP4nPzF1zUpRQ=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:36 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-e2c0a26b-13d1-463d-be55-9b61e799b366 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting quotas for project d32350a5bf9a4d8b80c6bc1708387d1f. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:20:36 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-e2c0a26b-13d1-463d-be55-9b61e799b366 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting quotas for user 29ed39378db34acd835d13c0cacad399 and project d32350a5bf9a4d8b80c6bc1708387d1f. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:20:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-e2c0a26b-13d1-463d-be55-9b61e799b366 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.227805 Apr 13 20:20:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 37/113] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:20:36 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Getting quotas for project 7b0fe0b98cb1466db76778e75e76bbc8. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Getting quotas for user be2777ed1017497ba7d96ca9d28e4d0c and project 7b0fe0b98cb1466db76778e75e76bbc8. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:20:36 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:20:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.516741 Apr 13 20:20:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 38/114] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:20:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:20:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-14d6d167-319b-4a4d-be01-6b4c60b65896 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:36 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-14d6d167-319b-4a4d-be01-6b4c60b65896 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:36 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-14d6d167-319b-4a4d-be01-6b4c60b65896 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2777ed1017497ba7d96ca9d28e4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0fe0b98cb1466db76778e75e76bbc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-14d6d167-319b-4a4d-be01-6b4c60b65896 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38" status: 200 len: 1208 microversion: 2.1 time: 0.073572 Apr 13 20:20:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 40/115] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:20:36 2023] GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38 => generated 1208 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:20:37 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "b2c1c646-b65c-4543-bf25-b89ff954fdd1"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:37 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] Creating event network-vif-plugged:b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:37 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048885 Apr 13 20:20:37 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 38/116] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:37 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "51a691d6-af80-4126-9fa3-99fd3ee39a9d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:37 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] Creating event network-vif-plugged:51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:37 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043136 Apr 13 20:20:37 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:20:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "0fc22c68-14c3-4803-952d-32dac032db89"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] Creating event network-vif-plugged:0fc22c68-14c3-4803-952d-32dac032db89 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043573 Apr 13 20:20:38 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 41/118] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:39 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "b2c1c646-b65c-4543-bf25-b89ff954fdd1"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "58a1b4af-7470-4cef-8c7a-7e611f8942fb"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "58a1b4af-7470-4cef-8c7a-7e611f8942fb"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "b3deaefd-62cd-4147-b744-783c9f5ff678"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:39 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Creating event network-vif-plugged:b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Creating event network-vif-plugged:58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Creating event network-vif-plugged:58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Creating event network-vif-plugged:b3deaefd-62cd-4147-b744-783c9f5ff678 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.039840 Apr 13 20:20:39 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:39 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "51a691d6-af80-4126-9fa3-99fd3ee39a9d"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "ee2ced5f-3757-4527-a93f-72d920a58291"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "ee2ced5f-3757-4527-a93f-72d920a58291"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "68c624f1-a380-4397-b311-6104fad344a8"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "68c624f1-a380-4397-b311-6104fad344a8"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Creating event network-vif-plugged:51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Creating event network-vif-plugged:ee2ced5f-3757-4527-a93f-72d920a58291 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Creating event network-vif-plugged:ee2ced5f-3757-4527-a93f-72d920a58291 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Creating event network-vif-plugged:68c624f1-a380-4397-b311-6104fad344a8 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Creating event network-vif-plugged:68c624f1-a380-4397-b311-6104fad344a8 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.036964 Apr 13 20:20:39 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 40/120] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "0fc22c68-14c3-4803-952d-32dac032db89"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] Creating event network-vif-plugged:0fc22c68-14c3-4803-952d-32dac032db89 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065533 Apr 13 20:20:40 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 42/121] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1172702095", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1904080569", "security_groups": [{"name": "tempest-secgroup-smoke-1161859881"}], "networks": [{"uuid": "2e78e6b2-a44b-40bd-a389-7c280074091d"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:40 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] validate_networks() for [('2e78e6b2-a44b-40bd-a389-7c280074091d', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "b3deaefd-62cd-4147-b744-783c9f5ff678"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting quotas for project d32350a5bf9a4d8b80c6bc1708387d1f. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting quotas for user 29ed39378db34acd835d13c0cacad399 and project d32350a5bf9a4d8b80c6bc1708387d1f. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:20:41 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:20:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] Creating event network-vif-plugged:b3deaefd-62cd-4147-b744-783c9f5ff678 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:20:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038344 Apr 13 20:20:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 43/122] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:41 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.595137 Apr 13 20:20:41 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 40/123] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:20:40 2023] POST /compute/v2.1/servers => generated 404 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:20:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bb64384b-5c96-4272-9cbb-3983b0932168 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:41 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-bb64384b-5c96-4272-9cbb-3983b0932168 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:41 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-bb64384b-5c96-4272-9cbb-3983b0932168 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-bb64384b-5c96-4272-9cbb-3983b0932168 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b" status: 200 len: 1237 microversion: 2.1 time: 0.180841 Apr 13 20:20:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 44/124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:20:41 2023] GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b => generated 1237 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:41 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:41 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7187e334-dfb0-443c-8857-f19e3e31abae tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 200 len: 1873 microversion: 2.32 time: 0.312573 Apr 13 20:20:41 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 41/125] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:20:41 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 1873 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:20:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4586f280-bf80-4ec1-b5bd-b51c11dc4d38", "tag": "afb15346-ee62-4c52-9603-035c27a22167"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] Creating event network-changed:afb15346-ee62-4c52-9603-035c27a22167 for instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 on user Apr 13 20:20:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040632 Apr 13 20:20:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 41/126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:42 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:42 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-964f23aa-9592-487b-98d9-c21da35fd1e5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.209058 Apr 13 20:20:42 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 45/127] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:20:42 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-interface => generated 283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4586f280-bf80-4ec1-b5bd-b51c11dc4d38", "name": "network-vif-plugged", "status": "completed", "tag": "afb15346-ee62-4c52-9603-035c27a22167"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] Creating event network-vif-plugged:afb15346-ee62-4c52-9603-035c27a22167 for instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 on user Apr 13 20:20:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036067 Apr 13 20:20:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:43 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-68758a84-82a2-4c69-ab07-cc921da7f923 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" status: 200 len: 2830 microversion: 2.42 time: 0.259873 Apr 13 20:20:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 42/129] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:20:43 2023] GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => generated 2830 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:20:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-920751465"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:44 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:45 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "132f09e1-e79c-4e4b-a11e-6548ba02aee6"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:45 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4586f280-bf80-4ec1-b5bd-b51c11dc4d38", "name": "network-vif-plugged", "status": "completed", "tag": "afb15346-ee62-4c52-9603-035c27a22167"}, {"name": "network-changed", "server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Creating event network-vif-plugged:afb15346-ee62-4c52-9603-035c27a22167 for instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 on user Apr 13 20:20:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Creating event network-changed:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:20:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046765 Apr 13 20:20:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:45 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:20:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482748 Apr 13 20:20:45 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 43/131] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:20:45 2023] POST /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "POST /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/action" status: 202 len: 0 microversion: 2.1 time: 1.185419 Apr 13 20:20:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 46/132] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:20:44 2023] POST /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/action => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 20:20:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a4093a4c-5085-4023-81b0-3524650d82d2 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '.version_select at 0x7f7838d73250>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a4093a4c-5085-4023-81b0-3524650d82d2 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/images/3acc4cf1-db6f-405d-8695-ddaf35363cfe" status: 200 len: 1610 microversion: 2.1 time: 0.066499 Apr 13 20:20:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 20:20:46 2023] GET /compute/v2.1/images/3acc4cf1-db6f-405d-8695-ddaf35363cfe => generated 1610 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ae109fe1-5d66-4560-8052-593803bfad3d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.144764 Apr 13 20:20:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 44/134] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 20:20:46 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-interface => generated 282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:20:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e0bb04-2572-4973-af9c-a607ca0b170b", "tag": "a174e8a4-6618-4819-92fe-4e08da521d07"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] Creating event network-changed:a174e8a4-6618-4819-92fe-4e08da521d07 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b on user Apr 13 20:20:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066272 Apr 13 20:20:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 47/135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:20:47 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:47 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:48 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-787aa8a4-c23b-471e-b00a-3cccdf35d20c tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/ips" status: 200 len: 110 microversion: 2.20 time: 0.391013 Apr 13 20:20:48 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 45/136] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 20:20:47 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/ips => generated 110 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:20:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}, {"server_uuid": "b9e0bb04-2572-4973-af9c-a607ca0b170b", "name": "network-vif-plugged", "status": "completed", "tag": "a174e8a4-6618-4819-92fe-4e08da521d07"}, {"server_uuid": "b9e0bb04-2572-4973-af9c-a607ca0b170b", "name": "network-vif-plugged", "status": "completed", "tag": "a174e8a4-6618-4819-92fe-4e08da521d07"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Creating event network-changed:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:20:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Creating event network-vif-plugged:a174e8a4-6618-4819-92fe-4e08da521d07 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b on user Apr 13 20:20:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Creating event network-vif-plugged:a174e8a4-6618-4819-92fe-4e08da521d07 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b on user Apr 13 20:20:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.056659 Apr 13 20:20:49 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 45/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:50 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:50 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:51 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'flavor' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:20:51 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/action" status: 202 len: 0 microversion: 2.20 time: 1.471699 Apr 13 20:20:52 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 48/138] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 20:20:50 2023] POST /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/action => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=10 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:52 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-18ea6872-bc74-490d-a7ab-1ffeb2c92c97 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 200 len: 1712 microversion: 2.20 time: 0.257931 Apr 13 20:20:52 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 46/139] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:20:52 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 1712 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:20:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-unplugged", "status": "completed", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] Creating event network-vif-unplugged:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:20:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051575 Apr 13 20:20:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:54 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:20:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-plugged", "status": "completed", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] Creating event network-vif-plugged:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:20:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031690 Apr 13 20:20:54 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10" status: 204 len: 0 microversion: 2.1 time: 0.197211 Apr 13 20:20:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 49/142] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:20:54 2023] DELETE /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:20:54 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:54 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fde0f5-70fc-49a5-96f9-b67ed1662a10", "name": "network-vif-unplugged", "status": "completed", "tag": "647040e8-c10a-43ef-ae04-6be7319fae12"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] Creating event network-vif-unplugged:647040e8-c10a-43ef-ae04-6be7319fae12 for instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 on user Apr 13 20:20:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030479 Apr 13 20:20:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 48/143] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:55 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50309fc4b92451f8cc40e92b10861ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6301bd811748429fd4bc6b1205e07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:20:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d301f499-34f5-4f59-bb51-0fd69be45481 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10" status: 200 len: 1541 microversion: 2.1 time: 0.329391 Apr 13 20:20:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 47/144] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:20:54 2023] GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => generated 1541 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:20:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-45d9759e-ad55-44de-8b8a-0faa229a4f46 req-58af1d40-8450-46d9-9cc8-618cafe8ec6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fde0f5-70fc-49a5-96f9-b67ed1662a10", "name": "network-vif-deleted", "tag": "647040e8-c10a-43ef-ae04-6be7319fae12"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-45d9759e-ad55-44de-8b8a-0faa229a4f46 req-58af1d40-8450-46d9-9cc8-618cafe8ec6f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-45d9759e-ad55-44de-8b8a-0faa229a4f46 req-58af1d40-8450-46d9-9cc8-618cafe8ec6f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-45d9759e-ad55-44de-8b8a-0faa229a4f46 req-58af1d40-8450-46d9-9cc8-618cafe8ec6f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-45d9759e-ad55-44de-8b8a-0faa229a4f46 req-58af1d40-8450-46d9-9cc8-618cafe8ec6f service nova] Creating event network-vif-deleted:647040e8-c10a-43ef-ae04-6be7319fae12 for instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 on user Apr 13 20:20:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-45d9759e-ad55-44de-8b8a-0faa229a4f46 req-58af1d40-8450-46d9-9cc8-618cafe8ec6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068704 Apr 13 20:20:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 50/145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6fde0f5-70fc-49a5-96f9-b67ed1662a10", "name": "network-vif-plugged", "status": "completed", "tag": "647040e8-c10a-43ef-ae04-6be7319fae12"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] Creating event network-vif-plugged:647040e8-c10a-43ef-ae04-6be7319fae12 for instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 on user Apr 13 20:20:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028792 Apr 13 20:20:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 49/146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:20:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:20:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] Creating event network-changed:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:20:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071093 Apr 13 20:20:59 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 48/147] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:20:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:20:59 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:20:59 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:20:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:20:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:20:59 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:20:59 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-cea71ec6-53c8-4951-92e0-a0cc41446b09 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.127490 Apr 13 20:20:59 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 51/148] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:20:59 2023] GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-interface => generated 282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:01 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0136288f-abaf-4a7c-a878-db415ff98f4b", "tag": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:01 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=37 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] Creating event network-changed:11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance 0136288f-abaf-4a7c-a878-db415ff98f4b on user Apr 13 20:21:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032493 Apr 13 20:21:01 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 50/149] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaf0e61a-7834-4a22-b869-ce73a5145adc"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:03 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:03 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322510 Apr 13 20:21:03 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 49/150] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:21:03 2023] POST /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:09 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-49a265d8-b482-461c-85cb-6a50f385c582 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.109983 Apr 13 20:21:09 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 52/151] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:21:09 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-interface => generated 282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da17669c-1ea2-450a-8183-40b47c4f41fc", "tag": "3e161dc0-b110-47f1-9a0a-f9add33a394b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:10 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] Creating event network-changed:3e161dc0-b110-47f1-9a0a-f9add33a394b for instance da17669c-1ea2-450a-8183-40b47c4f41fc on user Apr 13 20:21:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041899 Apr 13 20:21:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 51/152] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:10 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62f36d4a-1896-4762-a8b9-7d13520c2554"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:10 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282558 Apr 13 20:21:10 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 50/153] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:21:10 2023] POST /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ddb8d41d-f483-4066-b493-405b08c669ed"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] HTTP exception thrown: Volume ddb8d41d-f483-4066-b493-405b08c669ed could not be found. Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Request method failure captured: Apr 13 20:21:11 user devstack@n-api.service[61653]: request: PUT /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments/eaf0e61a-7834-4a22-b869-ce73a5145adc HTTP/1.1 Apr 13 20:21:11 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:21:11 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:21:11 user devstack@n-api.service[61653]: Connection: close Apr 13 20:21:11 user devstack@n-api.service[61653]: Content-Length: 74 Apr 13 20:21:11 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:21:11 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:21:11 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:21:11 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGO3rfeSd4tKEmV3dOGfOttyci5E3dKzDyJdpEYOIPZVGu9EM7Z5DbEZm07TVaizD3Crv2HGopYw71xNp7K57Jp2hcWuZ7OfrScMdhcPlILSTyFsLXwSWQ8yv0eg6kL97QOfjN0siXhljGtsbIduOlg3G2iIFcckY1sx695sEygRP-A Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Project-Id: a38a59e4a764409aa351b19c4797b7ad Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Project-Name: tempest-VolumesAdminNegativeTest-853684236 Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Role: admin,reader,member Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Roles: admin,reader,member Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a38a59e4a764409aa351b19c4797b7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a38a59e4a764409aa351b19c4797b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a38a59e4a764409aa351b19c4797b7ad"}]}] Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Tenant: tempest-VolumesAdminNegativeTest-853684236 Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Tenant-Id: a38a59e4a764409aa351b19c4797b7ad Apr 13 20:21:11 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-853684236 Apr 13 20:21:11 user devstack@n-api.service[61653]: X-User: tempest-VolumesAdminNegativeTest-853684236-project-admin Apr 13 20:21:11 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:21:11 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:21:11 user devstack@n-api.service[61653]: X-User-Id: a8623dfa03f64497aca285e4983766e6 Apr 13 20:21:11 user devstack@n-api.service[61653]: X-User-Name: tempest-VolumesAdminNegativeTest-853684236-project-admin Apr 13 20:21:11 user devstack@n-api.service[61653]: Apr 13 20:21:11 user devstack@n-api.service[61653]: {"volumeAttachment": {"volumeId": "ddb8d41d-f483-4066-b493-405b08c669ed"}} Apr 13 20:21:11 user devstack@n-api.service[61653]: method: > Apr 13 20:21:11 user devstack@n-api.service[61653]: exception: Volume ddb8d41d-f483-4066-b493-405b08c669ed could not be found. Apr 13 20:21:11 user devstack@n-api.service[61653]: action_args: {'server_id': '0136288f-abaf-4a7c-a878-db415ff98f4b', 'id': 'eaf0e61a-7834-4a22-b869-ce73a5145adc', 'body': {'volumeAttachment': {'volumeId': 'ddb8d41d-f483-4066-b493-405b08c669ed'}}} Apr 13 20:21:11 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ddb8d41d-f483-4066-b493-405b08c669ed could not be found. (HTTP 404) (Request-ID: req-a01d1a8b-6986-4977-81ee-79bf60b646ef) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ddb8d41d-f483-4066-b493-405b08c669ed could not be found. Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume ddb8d41d-f483-4066-b493-405b08c669ed could not be found. Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ddb8d41d-f483-4066-b493-405b08c669ed could not be found. Apr 13 20:21:11 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:11 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Returning 400 to user: Volume ddb8d41d-f483-4066-b493-405b08c669ed could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:21:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-715a42c8-d18a-4e0b-967d-07fd0c2f8dc8 tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments/eaf0e61a-7834-4a22-b869-ce73a5145adc" status: 400 len: 107 microversion: 2.1 time: 0.297688 Apr 13 20:21:11 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 53/154] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 20:21:11 2023] PUT /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments/eaf0e61a-7834-4a22-b869-ce73a5145adc => generated 107 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:11 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'services' on Instance uuid 0136288f-abaf-4a7c-a878-db415ff98f4b {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:21:11 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments/eaf0e61a-7834-4a22-b869-ce73a5145adc" status: 202 len: 0 microversion: 2.1 time: 0.299847 Apr 13 20:21:11 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 52/155] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:21:11 2023] DELETE /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments/eaf0e61a-7834-4a22-b869-ce73a5145adc => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:21:11 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:11 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2b9224f8-0346-4ff8-9c7e-3fa23b0d877f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051791 Apr 13 20:21:11 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 51/156] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:11 2023] GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:21:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:12 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0a403b8f-dec6-4f21-9b5e-ed04c6835480 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.112192 Apr 13 20:21:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 54/157] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:21:12 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-interface => generated 282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936eb14-b16e-46fb-9e39-5ba49da4fb73", "tag": "80e7738a-fc24-4b82-b70b-ae85ea74545f"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] Creating event network-changed:80e7738a-fc24-4b82-b70b-ae85ea74545f for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 on user Apr 13 20:21:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034900 Apr 13 20:21:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 53/158] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:14 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277476 Apr 13 20:21:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 52/159] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:21:14 2023] POST /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:15 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:15 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3f841216-ebb8-4af8-b8d1-dcd7f1de105c tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.121370 Apr 13 20:21:16 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 55/160] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 20:21:15 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-interface => generated 282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:21:16 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "tag": "3ac07688-57a6-45c2-9b2c-eea32bc1e446"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] Creating event network-changed:3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:21:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041364 Apr 13 20:21:16 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 54/161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:16 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:17 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:17 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:17 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:17 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-c4b364b5-68ed-464d-8505-4542c064d42f tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f" status: 200 len: 1625 microversion: 2.49 time: 0.192766 Apr 13 20:21:17 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 53/162] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:21:16 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f => generated 1625 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:21:17 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "tag": "nic-tag"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:17 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:18 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ed1aba59-6db5-47a3-bb7d-d1c2d80027b8"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:18 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:18 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "tag": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:18 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] Creating event network-changed:210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:21:18 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030700 Apr 13 20:21:18 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments/62f36d4a-1896-4762-a8b9-7d13520c2554" status: 202 len: 0 microversion: 2.1 time: 0.421321 Apr 13 20:21:19 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 55/164] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 20:21:18 2023] PUT /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments/62f36d4a-1896-4762-a8b9-7d13520c2554 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:21:19 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-plugged", "status": "completed", "tag": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] Creating event network-vif-plugged:210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:21:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052530 Apr 13 20:21:19 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 55/165] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:20 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.183589 Apr 13 20:21:20 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 56/166] 10.0.0.210 () {66 vars in 1414 bytes} [Thu Apr 13 20:21:17 2023] POST /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-interface => generated 282 bytes in 3185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:21:20 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb60aedd-5274-4ec7-8860-df6be02fcd12", "tag": "volume-tag"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:20 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.303754 Apr 13 20:21:20 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 56/167] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 20:21:20 2023] POST /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:21:21 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-plugged", "status": "completed", "tag": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:21 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] Creating event network-vif-plugged:210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:21:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038498 Apr 13 20:21:22 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 56/168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:22 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:22 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:22 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0d59c376-4eb0-416e-bb67-90e960ea8c22 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Apr 13 20:21:22 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:22 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:22 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lazy-loading 'services' on Instance uuid c936eb14-b16e-46fb-9e39-5ba49da4fb73 {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:21:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments/6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc" status: 202 len: 0 microversion: 2.1 time: 0.258892 Apr 13 20:21:23 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 57/170] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:21:22 2023] DELETE /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments/6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-db3e3162-a39f-44ca-ba0b-6490f0edd506 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041978 Apr 13 20:21:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:25 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:21:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:25 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6a7f5af6-0182-4948-9ce3-2515fbd73c60 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053414 Apr 13 20:21:25 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:25 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:25 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:21:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73" status: 204 len: 0 microversion: 2.1 time: 0.149571 Apr 13 20:21:25 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:21:25 2023] DELETE /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:25 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02540e30946f4e5c844c1e8f260e4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fff2eec2af433e9699cbc5be23e80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-15ea8ec1-5e69-471a-8dbe-f5a001b5b13b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73" status: 200 len: 1671 microversion: 2.1 time: 0.311252 Apr 13 20:21:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:21:25 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 => generated 1671 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:21:26 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936eb14-b16e-46fb-9e39-5ba49da4fb73", "name": "network-vif-unplugged", "status": "completed", "tag": "80e7738a-fc24-4b82-b70b-ae85ea74545f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] Creating event network-vif-unplugged:80e7738a-fc24-4b82-b70b-ae85ea74545f for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 on user Apr 13 20:21:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062655 Apr 13 20:21:26 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:26 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:27 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2777ed1017497ba7d96ca9d28e4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0fe0b98cb1466db76778e75e76bbc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:27 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1ce88cc4-e4e1-4e2f-b045-93a0f44bdd7d tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38" status: 200 len: 1454 microversion: 2.1 time: 0.244094 Apr 13 20:21:27 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:21:26 2023] GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38 => generated 1454 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:21:28 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936eb14-b16e-46fb-9e39-5ba49da4fb73", "name": "network-vif-deleted", "tag": "80e7738a-fc24-4b82-b70b-ae85ea74545f"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] Creating event network-vif-deleted:80e7738a-fc24-4b82-b70b-ae85ea74545f for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 on user Apr 13 20:21:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056463 Apr 13 20:21:28 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 59/177] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:28 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936eb14-b16e-46fb-9e39-5ba49da4fb73", "name": "network-vif-plugged", "status": "completed", "tag": "80e7738a-fc24-4b82-b70b-ae85ea74545f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:28 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] Creating event network-vif-plugged:80e7738a-fc24-4b82-b70b-ae85ea74545f for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 on user Apr 13 20:21:28 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050547 Apr 13 20:21:28 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 60/178] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:28 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'services' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:21:28 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-volume_attachments/cb60aedd-5274-4ec7-8860-df6be02fcd12" status: 202 len: 0 microversion: 2.49 time: 0.217997 Apr 13 20:21:28 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 60/179] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 20:21:28 2023] DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-volume_attachments/cb60aedd-5274-4ec7-8860-df6be02fcd12 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:31 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-interface/210d0fac-6751-4e8b-8d57-2ca9b09fdef9" status: 202 len: 0 microversion: 2.49 time: 0.171212 Apr 13 20:21:31 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 60/180] 10.0.0.210 () {64 vars in 1507 bytes} [Thu Apr 13 20:21:31 2023] DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-interface/210d0fac-6751-4e8b-8d57-2ca9b09fdef9 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7c876363-e6d9-4649-9394-7a8f5e3864ce tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-instance-actions/req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca" status: 200 len: 474 microversion: 2.49 time: 0.362266 Apr 13 20:21:31 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 61/181] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 20:21:31 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-instance-actions/req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca => generated 474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:31 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:31 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-67dc02bd-368a-49e1-82c9-1e3edaaa148d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b" status: 200 len: 1540 microversion: 2.1 time: 0.287903 Apr 13 20:21:31 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:21:31 2023] GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b => generated 1540 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:21:31 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-unplugged", "status": "completed", "tag": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] Creating event network-vif-unplugged:210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047441 Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:32 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 62/183] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:21:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-987a565b-45fb-4b1e-ab8d-acda9a61f47f tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 200 len: 2824 microversion: 2.32 time: 0.337049 Apr 13 20:21:32 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 61/184] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:21:31 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 2824 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-e3ed23df-aa6e-4649-a84f-4a0662b48d18 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055968 Apr 13 20:21:32 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:32 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-e6203496-1613-4856-b9e8-1c57009e152b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075213 Apr 13 20:21:32 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:32 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "62f36d4a-1896-4762-a8b9-7d13520c2554"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-deleted", "tag": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Creating event network-vif-deleted:210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:21:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033679 Apr 13 20:21:32 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 63/187] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments/ed1aba59-6db5-47a3-bb7d-d1c2d80027b8" status: 202 len: 0 microversion: 2.1 time: 0.389616 Apr 13 20:21:32 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 62/188] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 20:21:32 2023] PUT /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments/ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:21:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-plugged", "status": "completed", "tag": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] Creating event network-vif-plugged:210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:21:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032851 Apr 13 20:21:34 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-346ad08b-018b-452f-ad07-aa50b8c8e2ca tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '.version_select at 0x7f783821bc70>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-346ad08b-018b-452f-ad07-aa50b8c8e2ca tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/images/3acc4cf1-db6f-405d-8695-ddaf35363cfe" status: 200 len: 1724 microversion: 2.1 time: 0.056036 Apr 13 20:21:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 64/190] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 20:21:36 2023] GET /compute/v2.1/images/3acc4cf1-db6f-405d-8695-ddaf35363cfe => generated 1724 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:21:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-27b7a0ab-14f0-4a86-9ae3-333f68bdc542 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '.version_select at 0x7f78384f2050>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-27b7a0ab-14f0-4a86-9ae3-333f68bdc542 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/images/3acc4cf1-db6f-405d-8695-ddaf35363cfe" status: 200 len: 1724 microversion: 2.1 time: 0.053735 Apr 13 20:21:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 63/191] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 20:21:36 2023] GET /compute/v2.1/images/3acc4cf1-db6f-405d-8695-ddaf35363cfe => generated 1724 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:36 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb2df6092c342e0b0f44c37abb4a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3042be539b4749b37156c0e5a9d907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d47f92a0-67fc-4b85-9da0-cdfe66647f87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 200 len: 1672 microversion: 2.1 time: 0.151455 Apr 13 20:21:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:21:36 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=6,nova_cell1:UPDATE=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:42 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d2a6980b-3ece-4c94-98c9-6a3a2e4853b2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 200 len: 1653 microversion: 2.20 time: 0.251111 Apr 13 20:21:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 65/193] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:21:42 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 1653 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=27 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-947bd5fa-5b1c-4531-8e56-3036e3d8c2e4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.137286 Apr 13 20:21:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 64/194] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 20:21:43 2023] GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/os-interface => generated 1830 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:21:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "tag": "8a43e7e1-8da0-48b7-a18d-8899539118c7"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:44 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=30 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:44 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] Creating event network-changed:8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040972 Apr 13 20:21:44 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 66/195] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:44 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-349c4b80-95fa-408c-93df-bd518b6dcf31 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" status: 200 len: 2830 microversion: 2.42 time: 0.192453 Apr 13 20:21:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 66/196] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:21:44 2023] GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => generated 2830 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e86a5c13-4752-4cb3-9c8b-5b14fbae12b4 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.119203 Apr 13 20:21:45 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 65/197] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 20:21:45 2023] GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/os-interface => generated 1830 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] HTTP exception thrown: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Request method failure captured: Apr 13 20:21:45 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 HTTP/1.1 Apr 13 20:21:45 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:21:45 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:21:45 user devstack@n-api.service[61653]: Connection: close Apr 13 20:21:45 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:21:45 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:21:45 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:21:45 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:21:45 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOo6wHxPZxx0IMVQmy62yNkUR6p2JDfnIGN7MCogkJvq5JYtCcN92b_Jh0xiWm0TqEJmV1cGddD9JSegI7Dm5CledsBGT-IWsudo_7q_KVwm_nrsBom6U9hX3kwe0qiJ5Rw4nt6PjwGk-OmEbmg2uKwE2v5Xr3HuCEqaTAKrCBh5Q4 Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Project-Id: da6301bd811748429fd4bc6b1205e07d Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Project-Name: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da6301bd811748429fd4bc6b1205e07d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da6301bd811748429fd4bc6b1205e07d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da6301bd811748429fd4bc6b1205e07d"}]}] Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Tenant: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Tenant-Id: da6301bd811748429fd4bc6b1205e07d Apr 13 20:21:45 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:45 user devstack@n-api.service[61653]: X-User: tempest-DeleteServersTestJSON-537831244-project-member Apr 13 20:21:45 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:21:45 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:21:45 user devstack@n-api.service[61653]: X-User-Id: b50309fc4b92451f8cc40e92b10861ba Apr 13 20:21:45 user devstack@n-api.service[61653]: X-User-Name: tempest-DeleteServersTestJSON-537831244-project-member Apr 13 20:21:45 user devstack@n-api.service[61653]: method: > Apr 13 20:21:45 user devstack@n-api.service[61653]: exception: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61653]: action_args: {'id': 'b6fde0f5-70fc-49a5-96f9-b67ed1662a10'} Apr 13 20:21:45 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Returning 404 to user: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:21:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-38497d6b-ed44-49a3-a58c-1ed930c14773 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10" status: 404 len: 111 microversion: 2.1 time: 0.075113 Apr 13 20:21:45 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:21:45 2023] GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] HTTP exception thrown: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Request method failure captured: Apr 13 20:21:45 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/os-volume_attachments HTTP/1.1 Apr 13 20:21:45 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:21:45 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:21:45 user devstack@n-api.service[61655]: Connection: close Apr 13 20:21:45 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:21:45 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:21:45 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:21:45 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:21:45 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGOo6wHxPZxx0IMVQmy62yNkUR6p2JDfnIGN7MCogkJvq5JYtCcN92b_Jh0xiWm0TqEJmV1cGddD9JSegI7Dm5CledsBGT-IWsudo_7q_KVwm_nrsBom6U9hX3kwe0qiJ5Rw4nt6PjwGk-OmEbmg2uKwE2v5Xr3HuCEqaTAKrCBh5Q4 Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Project-Id: da6301bd811748429fd4bc6b1205e07d Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Project-Name: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da6301bd811748429fd4bc6b1205e07d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da6301bd811748429fd4bc6b1205e07d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da6301bd811748429fd4bc6b1205e07d"}]}] Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Tenant: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Tenant-Id: da6301bd811748429fd4bc6b1205e07d Apr 13 20:21:45 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:45 user devstack@n-api.service[61655]: X-User: tempest-DeleteServersTestJSON-537831244-project-member Apr 13 20:21:45 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:21:45 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:21:45 user devstack@n-api.service[61655]: X-User-Id: b50309fc4b92451f8cc40e92b10861ba Apr 13 20:21:45 user devstack@n-api.service[61655]: X-User-Name: tempest-DeleteServersTestJSON-537831244-project-member Apr 13 20:21:45 user devstack@n-api.service[61655]: method: > Apr 13 20:21:45 user devstack@n-api.service[61655]: exception: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61655]: action_args: {'server_id': 'b6fde0f5-70fc-49a5-96f9-b67ed1662a10'} Apr 13 20:21:45 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:45 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Returning 404 to user: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:21:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-0936fe38-c16c-44f9-b175-fa0f197f0c51 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032750 Apr 13 20:21:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:45 2023] GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-eb960794-1f4d-4478-881d-a853094c1a4c tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051303 Apr 13 20:21:45 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 66/200] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:45 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-af463483-62f9-4c41-bb0b-0624c17f1c34 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058793 Apr 13 20:21:45 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 68/201] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:45 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:45 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lazy-loading 'services' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:21:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments/62f36d4a-1896-4762-a8b9-7d13520c2554" status: 202 len: 0 microversion: 2.1 time: 0.163889 Apr 13 20:21:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:21:45 2023] DELETE /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments/62f36d4a-1896-4762-a8b9-7d13520c2554 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:45 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9c677a25-2640-4c13-96da-d102edd8736e tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056645 Apr 13 20:21:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 67/203] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:21:45 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:21:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" status: 204 len: 0 microversion: 2.42 time: 0.127660 Apr 13 20:21:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:21:46 2023] DELETE /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:46 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:21:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1caa052f-8431-44e1-88fd-beb345889abd tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" status: 200 len: 2955 microversion: 2.42 time: 0.231102 Apr 13 20:21:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 69/205] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:21:46 2023] GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => generated 2955 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "8a43e7e1-8da0-48b7-a18d-8899539118c7"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] Creating event network-vif-unplugged:8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048917 Apr 13 20:21:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "cd297158-7c28-4e96-9055-7547d626d066"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] Creating event network-vif-unplugged:cd297158-7c28-4e96-9055-7547d626d066 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051410 Apr 13 20:21:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 70/207] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:47 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "32e1b953-1235-44ba-918c-ff264b484629"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:47 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] Creating event network-vif-unplugged:32e1b953-1235-44ba-918c-ff264b484629 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:47 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047656 Apr 13 20:21:47 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] HTTP exception thrown: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:48 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Request method failure captured: Apr 13 20:21:48 user devstack@n-api.service[61654]: request: DELETE /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 HTTP/1.1 Apr 13 20:21:48 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:21:48 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:21:48 user devstack@n-api.service[61654]: Connection: close Apr 13 20:21:48 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:21:48 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:21:48 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:21:48 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:21:48 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGOo6wHxPZxx0IMVQmy62yNkUR6p2JDfnIGN7MCogkJvq5JYtCcN92b_Jh0xiWm0TqEJmV1cGddD9JSegI7Dm5CledsBGT-IWsudo_7q_KVwm_nrsBom6U9hX3kwe0qiJ5Rw4nt6PjwGk-OmEbmg2uKwE2v5Xr3HuCEqaTAKrCBh5Q4 Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Project-Id: da6301bd811748429fd4bc6b1205e07d Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Project-Name: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da6301bd811748429fd4bc6b1205e07d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da6301bd811748429fd4bc6b1205e07d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da6301bd811748429fd4bc6b1205e07d"}]}] Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Tenant: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Tenant-Id: da6301bd811748429fd4bc6b1205e07d Apr 13 20:21:48 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:48 user devstack@n-api.service[61654]: X-User: tempest-DeleteServersTestJSON-537831244-project-member Apr 13 20:21:48 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:21:48 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:21:48 user devstack@n-api.service[61654]: X-User-Id: b50309fc4b92451f8cc40e92b10861ba Apr 13 20:21:48 user devstack@n-api.service[61654]: X-User-Name: tempest-DeleteServersTestJSON-537831244-project-member Apr 13 20:21:48 user devstack@n-api.service[61654]: method: > Apr 13 20:21:48 user devstack@n-api.service[61654]: exception: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:48 user devstack@n-api.service[61654]: action_args: {'id': 'b6fde0f5-70fc-49a5-96f9-b67ed1662a10'} Apr 13 20:21:48 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:21:48 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:21:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:21:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:21:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:21:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:21:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:21:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Returning 404 to user: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:21:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-701884c5-b850-49c2-be9a-4ce7ba12b9d6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10" status: 404 len: 111 microversion: 2.1 time: 0.040035 Apr 13 20:21:49 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 69/209] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:21:48 2023] DELETE /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:21:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "8a43e7e1-8da0-48b7-a18d-8899539118c7"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "4e89cf33-c25a-42d7-be8d-bfeeea25e607"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "4e89cf33-c25a-42d7-be8d-bfeeea25e607"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Creating event network-vif-plugged:8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Creating event network-vif-unplugged:4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Creating event network-vif-plugged:4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Creating event network-vif-unplugged:1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Creating event network-vif-plugged:1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Creating event network-vif-unplugged:b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Creating event network-vif-plugged:b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] HTTP exception thrown: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Request method failure captured: Apr 13 20:21:49 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 HTTP/1.1 Apr 13 20:21:49 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:21:49 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:21:49 user devstack@n-api.service[61655]: Connection: close Apr 13 20:21:49 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:21:49 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:21:49 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:21:49 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:21:49 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGOo6wHxPZxx0IMVQmy62yNkUR6p2JDfnIGN7MCogkJvq5JYtCcN92b_Jh0xiWm0TqEJmV1cGddD9JSegI7Dm5CledsBGT-IWsudo_7q_KVwm_nrsBom6U9hX3kwe0qiJ5Rw4nt6PjwGk-OmEbmg2uKwE2v5Xr3HuCEqaTAKrCBh5Q4 Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Project-Id: da6301bd811748429fd4bc6b1205e07d Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Project-Name: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da6301bd811748429fd4bc6b1205e07d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da6301bd811748429fd4bc6b1205e07d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da6301bd811748429fd4bc6b1205e07d"}]}] Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Tenant: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Tenant-Id: da6301bd811748429fd4bc6b1205e07d Apr 13 20:21:49 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-DeleteServersTestJSON-537831244 Apr 13 20:21:49 user devstack@n-api.service[61655]: X-User: tempest-DeleteServersTestJSON-537831244-project-member Apr 13 20:21:49 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:21:49 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:21:49 user devstack@n-api.service[61655]: X-User-Id: b50309fc4b92451f8cc40e92b10861ba Apr 13 20:21:49 user devstack@n-api.service[61655]: X-User-Name: tempest-DeleteServersTestJSON-537831244-project-member Apr 13 20:21:49 user devstack@n-api.service[61655]: method: > Apr 13 20:21:49 user devstack@n-api.service[61655]: exception: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:49 user devstack@n-api.service[61655]: action_args: {'id': 'b6fde0f5-70fc-49a5-96f9-b67ed1662a10'} Apr 13 20:21:49 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. Apr 13 20:21:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.034487 Apr 13 20:21:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Returning 404 to user: Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:21:49 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 71/210] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 20:21:48 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:21:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-bed78435-c88b-4692-9a0c-45721413e6a0 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10" status: 404 len: 111 microversion: 2.1 time: 0.032411 Apr 13 20:21:49 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 71/211] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:21:48 2023] GET /compute/v2.1/servers/b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:21:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "cd297158-7c28-4e96-9055-7547d626d066"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] Creating event network-vif-plugged:cd297158-7c28-4e96-9055-7547d626d066 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Apr 13 20:21:49 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 70/212] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "32e1b953-1235-44ba-918c-ff264b484629"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-unplugged", "status": "completed", "tag": "12991ac8-5935-4b35-918a-015677766ea7"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-plugged", "status": "completed", "tag": "12991ac8-5935-4b35-918a-015677766ea7"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Creating event network-vif-plugged:32e1b953-1235-44ba-918c-ff264b484629 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Creating event network-vif-unplugged:12991ac8-5935-4b35-918a-015677766ea7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Creating event network-vif-plugged:12991ac8-5935-4b35-918a-015677766ea7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034829 Apr 13 20:21:49 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 72/213] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:49 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:21:51 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-deleted", "tag": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] Creating event network-vif-deleted:1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 Apr 13 20:21:51 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 72/214] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-deleted", "tag": "12991ac8-5935-4b35-918a-015677766ea7"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-deleted", "tag": "32e1b953-1235-44ba-918c-ff264b484629"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-deleted", "tag": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb"}, {"server_uuid": "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e", "name": "network-vif-deleted", "tag": "8a43e7e1-8da0-48b7-a18d-8899539118c7"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:21:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:21:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:21:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] Creating event network-vif-deleted:12991ac8-5935-4b35-918a-015677766ea7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] Creating event network-vif-deleted:32e1b953-1235-44ba-918c-ff264b484629 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] Creating event network-vif-deleted:b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] Creating event network-vif-deleted:8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e on user Apr 13 20:21:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.035345 Apr 13 20:21:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 71/215] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:21:59 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:59 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:21:59 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-38b7bf0d-0190-47ee-904f-94e7735bc684 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'create', calling method: .version_select at 0x7f78381b6440>, body: {"keypair": {"name": "tempest-keypair-262567265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg=="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:21:59 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-38b7bf0d-0190-47ee-904f-94e7735bc684 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting quotas for project 587bca93ee3f45b9b5b1ceb91e972e7b. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:21:59 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-38b7bf0d-0190-47ee-904f-94e7735bc684 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting quotas for user b5210a73b1574e82838f3f0ccef93a25 and project 587bca93ee3f45b9b5b1ceb91e972e7b. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:21:59 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-38b7bf0d-0190-47ee-904f-94e7735bc684 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.192785 Apr 13 20:21:59 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 73/216] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:21:59 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-492449566", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8ae2ae85-3644-4f35-bc04-a6af1ace6265"}], "security_groups": [{"name": "tempest-securitygroup--1685332145"}], "key_name": "tempest-keypair-262567265", "user_data": "}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:00 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] validate_networks() for [('8ae2ae85-3644-4f35-bc04-a6af1ace6265', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting quotas for project 587bca93ee3f45b9b5b1ceb91e972e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting quotas for user b5210a73b1574e82838f3f0ccef93a25 and project 587bca93ee3f45b9b5b1ceb91e972e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:22:01 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:22:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.548337 Apr 13 20:22:01 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 73/217] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:22:00 2023] POST /compute/v2.1/servers => generated 400 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:22:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-c2485208-2c3a-4a2a-9682-10daf9b75994 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:01 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-c2485208-2c3a-4a2a-9682-10daf9b75994 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:01 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-c2485208-2c3a-4a2a-9682-10daf9b75994 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-c2485208-2c3a-4a2a-9682-10daf9b75994 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1230 microversion: 2.1 time: 0.076044 Apr 13 20:22:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 72/218] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:01 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1230 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:02 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:02 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:02 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a08ba7a2-4292-4e15-8941-99169ce27e67 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046093 Apr 13 20:22:02 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 74/219] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:22:02 2023] GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-979321445", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "0307f481-3bd2-4735-bebd-a8e4fe253c1e"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] validate_networks() for [('0307f481-3bd2-4735-bebd-a8e4fe253c1e', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting quotas for project 41ed651e141447b995ccae680f1f3681. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting quotas for user 7cbfa14567af452db21cb0022514773b and project 41ed651e141447b995ccae680f1f3681. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:22:02 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:22:02 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.477072 Apr 13 20:22:02 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 74/220] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:22:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:22:02 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ddcefdfb-b9bc-46ea-9b0b-00433bde8cc2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:02 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ddcefdfb-b9bc-46ea-9b0b-00433bde8cc2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:02 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ddcefdfb-b9bc-46ea-9b0b-00433bde8cc2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cbfa14567af452db21cb0022514773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed651e141447b995ccae680f1f3681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:02 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ddcefdfb-b9bc-46ea-9b0b-00433bde8cc2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f" status: 200 len: 1211 microversion: 2.1 time: 0.062621 Apr 13 20:22:02 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 73/221] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:02 2023] GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f => generated 1211 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:03 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:03 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] Creating event network-changed:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:22:03 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056622 Apr 13 20:22:03 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 75/222] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:05 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66835d12-d155-4684-a9f0-41587936af9f", "tag": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:05 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] Creating event network-changed:96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance 66835d12-d155-4684-a9f0-41587936af9f on user Apr 13 20:22:05 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042398 Apr 13 20:22:05 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:06 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=28 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:22:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036230 Apr 13 20:22:06 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 74/224] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66835d12-d155-4684-a9f0-41587936af9f", "name": "network-vif-plugged", "status": "completed", "tag": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:07 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] Creating event network-vif-plugged:96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance 66835d12-d155-4684-a9f0-41587936af9f on user Apr 13 20:22:07 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057919 Apr 13 20:22:07 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 76/225] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:08 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:22:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029851 Apr 13 20:22:08 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 76/226] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:09 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66835d12-d155-4684-a9f0-41587936af9f", "name": "network-vif-plugged", "status": "completed", "tag": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] Creating event network-vif-plugged:96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance 66835d12-d155-4684-a9f0-41587936af9f on user Apr 13 20:22:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036053 Apr 13 20:22:09 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 75/227] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] HTTP exception thrown: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Request method failure captured: Apr 13 20:22:16 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 HTTP/1.1 Apr 13 20:22:16 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:22:16 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:22:16 user devstack@n-api.service[61653]: Connection: close Apr 13 20:22:16 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:22:16 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:22:16 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:22:16 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:22:16 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOn-SAX9s2dC3PtImZsy0Fv_z9qGvcvGt9ZwyzeWn9jA4LPIGY7MSAS4wrs2VlTPFTiu2IdA7-96j4ddibpTQqnfaiqa210iA5fLlDniYnPP0OfZbngHtx2n5gH3yAp83cj59R1Fs6ygLagzqCxIHW2jBNyM1zaYP4b6_hs426znUk Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Project-Id: a2fff2eec2af433e9699cbc5be23e80e Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2fff2eec2af433e9699cbc5be23e80e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a2fff2eec2af433e9699cbc5be23e80e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2fff2eec2af433e9699cbc5be23e80e"}]}] Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Tenant-Id: a2fff2eec2af433e9699cbc5be23e80e Apr 13 20:22:16 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:16 user devstack@n-api.service[61653]: X-User: tempest-AttachSCSIVolumeTestJSON-1525127673-project-member Apr 13 20:22:16 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:22:16 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:22:16 user devstack@n-api.service[61653]: X-User-Id: 02540e30946f4e5c844c1e8f260e4728 Apr 13 20:22:16 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1525127673-project-member Apr 13 20:22:16 user devstack@n-api.service[61653]: method: > Apr 13 20:22:16 user devstack@n-api.service[61653]: exception: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:16 user devstack@n-api.service[61653]: action_args: {'id': 'c936eb14-b16e-46fb-9e39-5ba49da4fb73'} Apr 13 20:22:16 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Returning 404 to user: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:22:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-709a1156-4dcf-4ade-9b9e-21e411fbc636 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73" status: 404 len: 111 microversion: 2.1 time: 0.030114 Apr 13 20:22:16 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:16 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:22:16 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-02274528-78f9-412c-8295-5aa46804de5b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '.version_select at 0x7f783821bbe0>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:16 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:16 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=12 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:16 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-02274528-78f9-412c-8295-5aa46804de5b tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964773546" status: 202 len: 0 microversion: 2.1 time: 0.033228 Apr 13 20:22:16 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 77/229] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 20:22:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964773546 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=29 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] HTTP exception thrown: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Request method failure captured: Apr 13 20:22:19 user devstack@n-api.service[61654]: request: DELETE /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 HTTP/1.1 Apr 13 20:22:19 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:22:19 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:22:19 user devstack@n-api.service[61654]: Connection: close Apr 13 20:22:19 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:22:19 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:22:19 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:22:19 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:22:19 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGOn-SAX9s2dC3PtImZsy0Fv_z9qGvcvGt9ZwyzeWn9jA4LPIGY7MSAS4wrs2VlTPFTiu2IdA7-96j4ddibpTQqnfaiqa210iA5fLlDniYnPP0OfZbngHtx2n5gH3yAp83cj59R1Fs6ygLagzqCxIHW2jBNyM1zaYP4b6_hs426znUk Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Project-Id: a2fff2eec2af433e9699cbc5be23e80e Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2fff2eec2af433e9699cbc5be23e80e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a2fff2eec2af433e9699cbc5be23e80e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2fff2eec2af433e9699cbc5be23e80e"}]}] Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Tenant-Id: a2fff2eec2af433e9699cbc5be23e80e Apr 13 20:22:19 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:19 user devstack@n-api.service[61654]: X-User: tempest-AttachSCSIVolumeTestJSON-1525127673-project-member Apr 13 20:22:19 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:22:19 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:22:19 user devstack@n-api.service[61654]: X-User-Id: 02540e30946f4e5c844c1e8f260e4728 Apr 13 20:22:19 user devstack@n-api.service[61654]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1525127673-project-member Apr 13 20:22:19 user devstack@n-api.service[61654]: method: > Apr 13 20:22:19 user devstack@n-api.service[61654]: exception: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61654]: action_args: {'id': 'c936eb14-b16e-46fb-9e39-5ba49da4fb73'} Apr 13 20:22:19 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Returning 404 to user: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:22:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6df2e33f-5ba5-492a-bfda-a9a29f330a36 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73" status: 404 len: 111 microversion: 2.1 time: 0.054858 Apr 13 20:22:19 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 76/230] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:22:19 2023] DELETE /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] HTTP exception thrown: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Request method failure captured: Apr 13 20:22:19 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 HTTP/1.1 Apr 13 20:22:19 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:22:19 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:22:19 user devstack@n-api.service[61653]: Connection: close Apr 13 20:22:19 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:22:19 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:22:19 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:22:19 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:22:19 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOn-SAX9s2dC3PtImZsy0Fv_z9qGvcvGt9ZwyzeWn9jA4LPIGY7MSAS4wrs2VlTPFTiu2IdA7-96j4ddibpTQqnfaiqa210iA5fLlDniYnPP0OfZbngHtx2n5gH3yAp83cj59R1Fs6ygLagzqCxIHW2jBNyM1zaYP4b6_hs426znUk Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Project-Id: a2fff2eec2af433e9699cbc5be23e80e Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2fff2eec2af433e9699cbc5be23e80e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a2fff2eec2af433e9699cbc5be23e80e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a2fff2eec2af433e9699cbc5be23e80e"}]}] Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Tenant-Id: a2fff2eec2af433e9699cbc5be23e80e Apr 13 20:22:19 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1525127673 Apr 13 20:22:19 user devstack@n-api.service[61653]: X-User: tempest-AttachSCSIVolumeTestJSON-1525127673-project-member Apr 13 20:22:19 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:22:19 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:22:19 user devstack@n-api.service[61653]: X-User-Id: 02540e30946f4e5c844c1e8f260e4728 Apr 13 20:22:19 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1525127673-project-member Apr 13 20:22:19 user devstack@n-api.service[61653]: method: > Apr 13 20:22:19 user devstack@n-api.service[61653]: exception: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61653]: action_args: {'id': 'c936eb14-b16e-46fb-9e39-5ba49da4fb73'} Apr 13 20:22:19 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. Apr 13 20:22:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Returning 404 to user: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:22:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-91994836-e905-47d6-9e3e-8b0e54ac2dbe tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73" status: 404 len: 111 microversion: 2.1 time: 0.036817 Apr 13 20:22:19 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:19 2023] GET /compute/v2.1/servers/c936eb14-b16e-46fb-9e39-5ba49da4fb73 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=8 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:21 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-13708890-86f3-4029-a223-1b9de58f26dc tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-instance-actions/req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca" status: 200 len: 503 microversion: 2.49 time: 0.112745 Apr 13 20:22:21 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 78/232] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 20:22:21 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-instance-actions/req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca => generated 503 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:22:21 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:21 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:21 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-56860d45-b31a-4064-92c7-2dbb44a57c95 tempest-TaggedAttachmentsTest-1288045035 tempest-TaggedAttachmentsTest-1288045035-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-instance-actions/req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca" status: 200 len: 503 microversion: 2.49 time: 0.108159 Apr 13 20:22:21 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 77/233] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 20:22:21 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-instance-actions/req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca => generated 503 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:22 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a46ff868-7dce-406e-b01c-e8ebff830ca9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.049643 Apr 13 20:22:22 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 79/234] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 20:22:22 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:22 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:22:22 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f" status: 204 len: 0 microversion: 2.49 time: 0.133551 Apr 13 20:22:22 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 79/235] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:22:22 2023] DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:22 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-084b789d-0964-4a7e-9c6f-68be635b5d4e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f" status: 200 len: 1749 microversion: 2.49 time: 0.205554 Apr 13 20:22:22 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 78/236] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:22:22 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f => generated 1749 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-unplugged", "status": "completed", "tag": "3ac07688-57a6-45c2-9b2c-eea32bc1e446"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:22 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] Creating event network-vif-unplugged:3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:22:22 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041312 Apr 13 20:22:22 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 80/237] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:23 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-deleted", "tag": "3ac07688-57a6-45c2-9b2c-eea32bc1e446"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] Creating event network-vif-deleted:3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:22:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033435 Apr 13 20:22:23 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:24 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78111f4-fcd5-4efc-977e-d8d32225c83f", "name": "network-vif-plugged", "status": "completed", "tag": "3ac07688-57a6-45c2-9b2c-eea32bc1e446"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] Creating event network-vif-plugged:3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f on user Apr 13 20:22:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028122 Apr 13 20:22:24 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 79/239] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:27 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:22:27 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38" status: 204 len: 0 microversion: 2.1 time: 0.144501 Apr 13 20:22:27 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 81/240] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:22:27 2023] DELETE /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:27 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2777ed1017497ba7d96ca9d28e4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0fe0b98cb1466db76778e75e76bbc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:27 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2c62abbc-ea1c-4c0e-9245-80ffc925c1d9 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38" status: 200 len: 1460 microversion: 2.1 time: 0.177240 Apr 13 20:22:27 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 81/241] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:27 2023] GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38 => generated 1460 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:27 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4586f280-bf80-4ec1-b5bd-b51c11dc4d38", "name": "network-vif-unplugged", "status": "completed", "tag": "afb15346-ee62-4c52-9603-035c27a22167"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] Creating event network-vif-unplugged:afb15346-ee62-4c52-9603-035c27a22167 for instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 on user Apr 13 20:22:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036379 Apr 13 20:22:27 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 80/242] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:28 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d664f790-3a00-464b-9147-625f60e6a33f tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Action: 'create', calling method: .version_select at 0x7f78381b5240>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-834589812", "metadata": {"Type": "work"}}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:28 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-d67249cb-280c-4006-82b1-f62c17538ad3 req-03e540cb-0436-4ef8-9f31-a2444d37c5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4586f280-bf80-4ec1-b5bd-b51c11dc4d38", "name": "network-vif-deleted", "tag": "afb15346-ee62-4c52-9603-035c27a22167"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d67249cb-280c-4006-82b1-f62c17538ad3 req-03e540cb-0436-4ef8-9f31-a2444d37c5b0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d67249cb-280c-4006-82b1-f62c17538ad3 req-03e540cb-0436-4ef8-9f31-a2444d37c5b0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d67249cb-280c-4006-82b1-f62c17538ad3 req-03e540cb-0436-4ef8-9f31-a2444d37c5b0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:28 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d664f790-3a00-464b-9147-625f60e6a33f tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.487569 Apr 13 20:22:28 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 82/243] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 20:22:27 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 489 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 20:22:28 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-67ba45ec-4e23-4105-a885-596b4d52f65c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Calling method '.version_select at 0x7f783816f130>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:28 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-d67249cb-280c-4006-82b1-f62c17538ad3 req-03e540cb-0436-4ef8-9f31-a2444d37c5b0 service nova] Creating event network-vif-deleted:afb15346-ee62-4c52-9603-035c27a22167 for instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 on user Apr 13 20:22:28 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-d67249cb-280c-4006-82b1-f62c17538ad3 req-03e540cb-0436-4ef8-9f31-a2444d37c5b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050074 Apr 13 20:22:28 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 82/244] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-67ba45ec-4e23-4105-a885-596b4d52f65c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892" status: 200 len: 352 microversion: 2.1 time: 0.059247 Apr 13 20:22:28 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 81/245] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:22:28 2023] GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7e127637-4e40-491f-9086-1fe8d14ab985 tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Calling method '.version_select at 0x7f78381f9360>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:29 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7e127637-4e40-491f-9086-1fe8d14ab985 tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892" status: 200 len: 353 microversion: 2.1 time: 0.051997 Apr 13 20:22:29 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 83/246] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:22:29 2023] GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d402e708-7a18-46a6-9f37-51f4b712f1a1 tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Calling method '.version_select at 0x7f78381476d0>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d402e708-7a18-46a6-9f37-51f4b712f1a1 tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892" status: 200 len: 353 microversion: 2.1 time: 0.050351 Apr 13 20:22:29 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 83/247] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:22:29 2023] GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:22:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a3e00836-c470-4f52-8aff-e42a833c1895 tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Calling method '.version_select at 0x7f78384f2320>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4586f280-bf80-4ec1-b5bd-b51c11dc4d38", "name": "network-vif-plugged", "status": "completed", "tag": "afb15346-ee62-4c52-9603-035c27a22167"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:29 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:29 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:29 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] Creating event network-vif-plugged:afb15346-ee62-4c52-9603-035c27a22167 for instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 on user Apr 13 20:22:29 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036508 Apr 13 20:22:29 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 84/248] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a3e00836-c470-4f52-8aff-e42a833c1895 tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892" status: 202 len: 0 microversion: 2.1 time: 0.070804 Apr 13 20:22:29 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 82/249] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:22:29 2023] DELETE /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:22:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4085fa68-4bac-455b-881f-4883bf65ea8f tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Calling method '.version_select at 0x7f783821b910>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4085fa68-4bac-455b-881f-4883bf65ea8f tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892" status: 200 len: 352 microversion: 2.1 time: 0.051590 Apr 13 20:22:29 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:22:29 2023] GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a0378bb6-af1b-4570-a0fc-9c6b1c6d9e2c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Calling method '.version_select at 0x7f78381b69e0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a0378bb6-af1b-4570-a0fc-9c6b1c6d9e2c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892" status: 200 len: 352 microversion: 2.1 time: 0.095130 Apr 13 20:22:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 85/251] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:22:30 2023] GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:31 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3914c241-2281-49b4-aeb0-425426265b2c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Calling method '.version_select at 0x7f7838434b80>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:31 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-3914c241-2281-49b4-aeb0-425426265b2c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] HTTP exception thrown: Volume 563b7821-f533-43e3-a44c-31d253761892 could not be found. Apr 13 20:22:31 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3914c241-2281-49b4-aeb0-425426265b2c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Request method failure captured: Apr 13 20:22:31 user devstack@n-api.service[61654]: request: GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892 HTTP/1.1 Apr 13 20:22:31 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:22:31 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:22:31 user devstack@n-api.service[61654]: Connection: close Apr 13 20:22:31 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:22:31 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:22:31 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:22:31 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:22:31 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGSDq0b2bUTGBex2_5-Zl_FLl2UAYDEcq23e3zGCyVY6KfSsB363NRok9VyB44lZxAReI5Mpo_vnWOPOBO8jbXlwtCO_zeLGck26d3MHQl17t3AYWnQ7ddhnk73t5nmWdQLeXzKXjU2jrbAev_CiZI6mvq7Ni613x2uBlLoDXjMwu0A Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Project-Id: 73d6d79a13f0495f9de26f5d07f46bb0 Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesGetTestJSON-1287749584 Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73d6d79a13f0495f9de26f5d07f46bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73d6d79a13f0495f9de26f5d07f46bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73d6d79a13f0495f9de26f5d07f46bb0"}]}] Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesGetTestJSON-1287749584 Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Tenant-Id: 73d6d79a13f0495f9de26f5d07f46bb0 Apr 13 20:22:31 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesGetTestJSON-1287749584 Apr 13 20:22:31 user devstack@n-api.service[61654]: X-User: tempest-VolumesGetTestJSON-1287749584-project-member Apr 13 20:22:31 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:22:31 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:22:31 user devstack@n-api.service[61654]: X-User-Id: 370b3bfa314342b8b5f4587571ab6bbc Apr 13 20:22:31 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesGetTestJSON-1287749584-project-member Apr 13 20:22:31 user devstack@n-api.service[61654]: method: Apr 13 20:22:31 user devstack@n-api.service[61654]: exception: Volume 563b7821-f533-43e3-a44c-31d253761892 could not be found. Apr 13 20:22:31 user devstack@n-api.service[61654]: action_args: {'id': '563b7821-f533-43e3-a44c-31d253761892'} Apr 13 20:22:31 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 563b7821-f533-43e3-a44c-31d253761892 could not be found. (HTTP 404) (Request-ID: req-a4b7fca7-cbf8-4651-9097-bea2e4c300a8) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:22:31 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 563b7821-f533-43e3-a44c-31d253761892 could not be found. Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 563b7821-f533-43e3-a44c-31d253761892 could not be found. Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 563b7821-f533-43e3-a44c-31d253761892 could not be found. Apr 13 20:22:32 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:22:32 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3914c241-2281-49b4-aeb0-425426265b2c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] Returning 404 to user: Volume 563b7821-f533-43e3-a44c-31d253761892 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:22:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-3914c241-2281-49b4-aeb0-425426265b2c tempest-VolumesGetTestJSON-1287749584 tempest-VolumesGetTestJSON-1287749584-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892" status: 404 len: 109 microversion: 2.1 time: 0.118547 Apr 13 20:22:32 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 83/252] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:22:31 2023] GET /compute/v2.1/os-volumes/563b7821-f533-43e3-a44c-31d253761892 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:32 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:32 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:32 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8b50cc2d-37a9-4e34-b3e9-495d337f00d5 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b" status: 200 len: 1540 microversion: 2.1 time: 0.224144 Apr 13 20:22:32 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:32 2023] GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b => generated 1540 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-cab48678-63f5-4f83-85a8-07d7f3a08d44 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.205752 Apr 13 20:22:32 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 86/254] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 20:22:32 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/os-interface => generated 1829 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:22:33 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "tag": "b2c1c646-b65c-4543-bf25-b89ff954fdd1"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] Creating event network-changed:b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039874 Apr 13 20:22:33 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 84/255] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:33 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:33 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-50786dcc-ec47-4675-8a3f-131df600c349 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 200 len: 2824 microversion: 2.32 time: 0.383782 Apr 13 20:22:34 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 86/256] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:22:33 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 2824 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:22:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:34 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d1d175d7-9608-4c34-b958-ed4f98412bab tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.236454 Apr 13 20:22:34 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 87/257] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 20:22:34 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/os-interface => generated 1829 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:22:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e0bb04-2572-4973-af9c-a607ca0b170b", "tag": "a174e8a4-6618-4819-92fe-4e08da521d07"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] Creating event network-changed:a174e8a4-6618-4819-92fe-4e08da521d07 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b on user Apr 13 20:22:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029718 Apr 13 20:22:34 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 85/258] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14b662bc-beb2-4e07-bd32-8d54ee3e1748"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:35 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288189 Apr 13 20:22:35 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:22:34 2023] POST /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:35 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:22:35 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 204 len: 0 microversion: 2.32 time: 0.181088 Apr 13 20:22:35 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 88/260] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:22:35 2023] DELETE /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:35 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-83e12532-02c9-49c3-8703-f0ddfd327cbb tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 200 len: 2949 microversion: 2.32 time: 0.296643 Apr 13 20:22:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 86/261] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:22:35 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 2949 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6452f245-e348-4685-a682-f7e0e2bd5514 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094901 Apr 13 20:22:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:22:36 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-unplugged", "status": "completed", "tag": "51a691d6-af80-4126-9fa3-99fd3ee39a9d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] Creating event network-vif-unplugged:51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061300 Apr 13 20:22:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 89/263] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-unplugged", "status": "completed", "tag": "0fc22c68-14c3-4803-952d-32dac032db89"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=35 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] Creating event network-vif-unplugged:0fc22c68-14c3-4803-952d-32dac032db89 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038070 Apr 13 20:22:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 87/264] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:22:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc" status: 204 len: 0 microversion: 2.1 time: 0.166914 Apr 13 20:22:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:22:36 2023] DELETE /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '195c6c0bc1ec4796b5c1e2ba88c7534a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49944b378c2b4e618a631771465a4a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-53affd05-d60f-445a-aa24-11ddafe29260 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc" status: 200 len: 1650 microversion: 2.1 time: 0.312973 Apr 13 20:22:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 90/266] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:36 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc => generated 1650 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-unplugged", "status": "completed", "tag": "b2c1c646-b65c-4543-bf25-b89ff954fdd1"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "b2c1c646-b65c-4543-bf25-b89ff954fdd1"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-unplugged", "status": "completed", "tag": "58a1b4af-7470-4cef-8c7a-7e611f8942fb"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Creating event network-vif-unplugged:b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Creating event network-vif-plugged:b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Creating event network-vif-unplugged:58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.067521 Apr 13 20:22:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] HTTP exception thrown: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 88/267] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Request method failure captured: Apr 13 20:22:36 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e HTTP/1.1 Apr 13 20:22:36 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:22:36 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:22:36 user devstack@n-api.service[61655]: Connection: close Apr 13 20:22:36 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:22:36 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:22:36 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:22:36 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:22:36 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGOkBK-DTygItkU5WVkNf27ApJQehwwCiSDP2tg9zGjE41VWbFr0W4l1nsPBMjYs7lR8MbrbKSbCkP1f8s7aNbSJpKdXuOpqtdLRgf2fNILH1UZBqZ6alfEfM6glQB8fiPPmO_7M8twPj4vao4laWwv7W6mdEMWfI9suLZs9MZrN-_k Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Project-Id: e01e2122799d4cfe81a642146f5c1421 Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e01e2122799d4cfe81a642146f5c1421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e01e2122799d4cfe81a642146f5c1421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e01e2122799d4cfe81a642146f5c1421"}]}] Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Tenant-Id: e01e2122799d4cfe81a642146f5c1421 Apr 13 20:22:36 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:36 user devstack@n-api.service[61655]: X-User: tempest-TaggedBootDevicesTest_v242-1937190346-project-member Apr 13 20:22:36 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:22:36 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:22:36 user devstack@n-api.service[61655]: X-User-Id: 5a2f99d6d3ee4f1b968dcc6ed6fccb84 Apr 13 20:22:36 user devstack@n-api.service[61655]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1937190346-project-member Apr 13 20:22:36 user devstack@n-api.service[61655]: method: > Apr 13 20:22:36 user devstack@n-api.service[61655]: exception: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:36 user devstack@n-api.service[61655]: action_args: {'id': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'} Apr 13 20:22:36 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Returning 404 to user: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:22:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2a51b42b-8a50-49f8-8b85-2173ec557c95 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" status: 404 len: 111 microversion: 2.42 time: 0.047656 Apr 13 20:22:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 90/268] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:22:36 2023] GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:22:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0731426f-3a29-4a99-a2e6-29d4f26cc442 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '.version_select at 0x7f78381b70a0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0731426f-3a29-4a99-a2e6-29d4f26cc442 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712483657" status: 204 len: 0 microversion: 2.42 time: 0.037250 Apr 13 20:22:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 91/269] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 20:22:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712483657 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:37 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb2df6092c342e0b0f44c37abb4a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3042be539b4749b37156c0e5a9d907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:37 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b2d3b979-5504-408d-985e-49bb1282ca87 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 200 len: 1672 microversion: 2.1 time: 0.318990 Apr 13 20:22:37 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 89/270] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:36 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 1672 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "51a691d6-af80-4126-9fa3-99fd3ee39a9d"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-unplugged", "status": "completed", "tag": "ee2ced5f-3757-4527-a93f-72d920a58291"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "ee2ced5f-3757-4527-a93f-72d920a58291"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-unplugged", "status": "completed", "tag": "68c624f1-a380-4397-b311-6104fad344a8"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "68c624f1-a380-4397-b311-6104fad344a8"}, {"server_uuid": "da17669c-1ea2-450a-8183-40b47c4f41fc", "name": "network-vif-unplugged", "status": "completed", "tag": "3e161dc0-b110-47f1-9a0a-f9add33a394b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Creating event network-vif-plugged:51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Creating event network-vif-unplugged:ee2ced5f-3757-4527-a93f-72d920a58291 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Creating event network-vif-plugged:ee2ced5f-3757-4527-a93f-72d920a58291 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Creating event network-vif-unplugged:68c624f1-a380-4397-b311-6104fad344a8 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Creating event network-vif-plugged:68c624f1-a380-4397-b311-6104fad344a8 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Creating event network-vif-unplugged:3e161dc0-b110-47f1-9a0a-f9add33a394b for instance da17669c-1ea2-450a-8183-40b47c4f41fc on user Apr 13 20:22:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.043730 Apr 13 20:22:38 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 91/271] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "0fc22c68-14c3-4803-952d-32dac032db89"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] Creating event network-vif-plugged:0fc22c68-14c3-4803-952d-32dac032db89 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035747 Apr 13 20:22:38 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:38 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "58a1b4af-7470-4cef-8c7a-7e611f8942fb"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-unplugged", "status": "completed", "tag": "b3deaefd-62cd-4147-b744-783c9f5ff678"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-plugged", "status": "completed", "tag": "b3deaefd-62cd-4147-b744-783c9f5ff678"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73e8450f-52ed-4e90-83e8-1ba72b5e60cb"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Creating event network-vif-plugged:58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Creating event network-vif-unplugged:b3deaefd-62cd-4147-b744-783c9f5ff678 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Creating event network-vif-plugged:b3deaefd-62cd-4147-b744-783c9f5ff678 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.049868 Apr 13 20:22:38 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 90/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:39 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:39 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "POST /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291615 Apr 13 20:22:39 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 92/274] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:22:38 2023] POST /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da17669c-1ea2-450a-8183-40b47c4f41fc", "name": "network-vif-plugged", "status": "completed", "tag": "3e161dc0-b110-47f1-9a0a-f9add33a394b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] Creating event network-vif-plugged:3e161dc0-b110-47f1-9a0a-f9add33a394b for instance da17669c-1ea2-450a-8183-40b47c4f41fc on user Apr 13 20:22:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053487 Apr 13 20:22:40 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 93/275] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-9ebf6e16-00dc-43b6-8f0c-bf82a8b412db req-26207d45-e229-4eb6-8352-9099e0f8edf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da17669c-1ea2-450a-8183-40b47c4f41fc", "name": "network-vif-deleted", "tag": "3e161dc0-b110-47f1-9a0a-f9add33a394b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9ebf6e16-00dc-43b6-8f0c-bf82a8b412db req-26207d45-e229-4eb6-8352-9099e0f8edf8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9ebf6e16-00dc-43b6-8f0c-bf82a8b412db req-26207d45-e229-4eb6-8352-9099e0f8edf8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9ebf6e16-00dc-43b6-8f0c-bf82a8b412db req-26207d45-e229-4eb6-8352-9099e0f8edf8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-9ebf6e16-00dc-43b6-8f0c-bf82a8b412db req-26207d45-e229-4eb6-8352-9099e0f8edf8 service nova] Creating event network-vif-deleted:3e161dc0-b110-47f1-9a0a-f9add33a394b for instance da17669c-1ea2-450a-8183-40b47c4f41fc on user Apr 13 20:22:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-9ebf6e16-00dc-43b6-8f0c-bf82a8b412db req-26207d45-e229-4eb6-8352-9099e0f8edf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046180 Apr 13 20:22:40 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 91/276] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:41 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] HTTP exception thrown: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Request method failure captured: Apr 13 20:22:41 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e HTTP/1.1 Apr 13 20:22:41 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:22:41 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:22:41 user devstack@n-api.service[61655]: Connection: close Apr 13 20:22:41 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:22:41 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:22:41 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:22:41 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:22:41 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGOkBK-DTygItkU5WVkNf27ApJQehwwCiSDP2tg9zGjE41VWbFr0W4l1nsPBMjYs7lR8MbrbKSbCkP1f8s7aNbSJpKdXuOpqtdLRgf2fNILH1UZBqZ6alfEfM6glQB8fiPPmO_7M8twPj4vao4laWwv7W6mdEMWfI9suLZs9MZrN-_k Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Project-Id: e01e2122799d4cfe81a642146f5c1421 Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e01e2122799d4cfe81a642146f5c1421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e01e2122799d4cfe81a642146f5c1421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e01e2122799d4cfe81a642146f5c1421"}]}] Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Tenant-Id: e01e2122799d4cfe81a642146f5c1421 Apr 13 20:22:41 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:41 user devstack@n-api.service[61655]: X-User: tempest-TaggedBootDevicesTest_v242-1937190346-project-member Apr 13 20:22:41 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:22:41 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:22:41 user devstack@n-api.service[61655]: X-User-Id: 5a2f99d6d3ee4f1b968dcc6ed6fccb84 Apr 13 20:22:41 user devstack@n-api.service[61655]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1937190346-project-member Apr 13 20:22:41 user devstack@n-api.service[61655]: method: > Apr 13 20:22:41 user devstack@n-api.service[61655]: exception: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61655]: action_args: {'id': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'} Apr 13 20:22:41 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Returning 404 to user: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:22:41 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b6cfad1b-913a-4aeb-9d98-c5a1e541ee72 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" status: 404 len: 111 microversion: 2.42 time: 0.039827 Apr 13 20:22:41 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 93/277] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:22:41 2023] DELETE /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] HTTP exception thrown: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Request method failure captured: Apr 13 20:22:41 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e HTTP/1.1 Apr 13 20:22:41 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:22:41 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:22:41 user devstack@n-api.service[61653]: Connection: close Apr 13 20:22:41 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:22:41 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:22:41 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:22:41 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:22:41 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOkBK-DTygItkU5WVkNf27ApJQehwwCiSDP2tg9zGjE41VWbFr0W4l1nsPBMjYs7lR8MbrbKSbCkP1f8s7aNbSJpKdXuOpqtdLRgf2fNILH1UZBqZ6alfEfM6glQB8fiPPmO_7M8twPj4vao4laWwv7W6mdEMWfI9suLZs9MZrN-_k Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Project-Id: e01e2122799d4cfe81a642146f5c1421 Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e01e2122799d4cfe81a642146f5c1421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e01e2122799d4cfe81a642146f5c1421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e01e2122799d4cfe81a642146f5c1421"}]}] Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Tenant-Id: e01e2122799d4cfe81a642146f5c1421 Apr 13 20:22:41 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1937190346 Apr 13 20:22:41 user devstack@n-api.service[61653]: X-User: tempest-TaggedBootDevicesTest_v242-1937190346-project-member Apr 13 20:22:41 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:22:41 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:22:41 user devstack@n-api.service[61653]: X-User-Id: 5a2f99d6d3ee4f1b968dcc6ed6fccb84 Apr 13 20:22:41 user devstack@n-api.service[61653]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1937190346-project-member Apr 13 20:22:41 user devstack@n-api.service[61653]: method: > Apr 13 20:22:41 user devstack@n-api.service[61653]: exception: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61653]: action_args: {'id': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'} Apr 13 20:22:41 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. Apr 13 20:22:41 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:22:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Returning 404 to user: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:22:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-26536a31-c37a-45b4-b30f-9e1caa83c6b7 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" status: 404 len: 111 microversion: 2.42 time: 0.095840 Apr 13 20:22:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 94/278] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:22:41 2023] GET /compute/v2.1/servers/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:22:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-deleted", "tag": "68c624f1-a380-4397-b311-6104fad344a8"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-deleted", "tag": "b3deaefd-62cd-4147-b744-783c9f5ff678"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-deleted", "tag": "b2c1c646-b65c-4543-bf25-b89ff954fdd1"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] Creating event network-vif-deleted:68c624f1-a380-4397-b311-6104fad344a8 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] Creating event network-vif-deleted:b3deaefd-62cd-4147-b744-783c9f5ff678 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] Creating event network-vif-deleted:b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037468 Apr 13 20:22:42 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 92/279] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:42 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:43 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b609e963-4f61-4f0f-9b69-d7de7e317b48 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.432114 Apr 13 20:22:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 94/280] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 20:22:43 2023] POST /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments => generated 188 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:43 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61653) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 20:22:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/action" status: 202 len: 0 microversion: 2.20 time: 0.116938 Apr 13 20:22:43 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 95/281] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 20:22:43 2023] POST /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:43 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ea7ad94f-54d8-412f-a4b0-1e330a60d669 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 200 len: 1739 microversion: 2.20 time: 0.183047 Apr 13 20:22:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 93/282] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:22:43 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:22:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-deleted", "tag": "ee2ced5f-3757-4527-a93f-72d920a58291"}, {"server_uuid": "8587fcac-cc5b-4fe7-92f9-8bf675a9a872", "name": "network-vif-deleted", "tag": "0fc22c68-14c3-4803-952d-32dac032db89"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] Creating event network-vif-deleted:ee2ced5f-3757-4527-a93f-72d920a58291 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] Creating event network-vif-deleted:0fc22c68-14c3-4803-952d-32dac032db89 for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 on user Apr 13 20:22:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067831 Apr 13 20:22:44 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 95/283] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:45 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:46 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'services' on Instance uuid b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:22:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments/14b662bc-beb2-4e07-bd32-8d54ee3e1748" status: 202 len: 0 microversion: 2.1 time: 1.396105 Apr 13 20:22:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:22:45 2023] DELETE /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments/14b662bc-beb2-4e07-bd32-8d54ee3e1748 => generated 0 bytes in 1398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:22:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ec87743f-f5ac-4ce2-85c0-694b84a6daff tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060246 Apr 13 20:22:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 94/285] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:22:46 2023] GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "3acc4cf1-db6f-405d-8695-ddaf35363cfe"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:49 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'flavor' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:22:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "POST /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/action" status: 200 len: 29 microversion: 2.1 time: 0.337893 Apr 13 20:22:49 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 96/286] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:22:49 2023] POST /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/action => generated 29 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 13 20:22:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:49 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:50 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb2df6092c342e0b0f44c37abb4a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3042be539b4749b37156c0e5a9d907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:50 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-28356070-a5c6-4ff9-8843-093fa5dde3ab tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 200 len: 1724 microversion: 2.1 time: 0.520370 Apr 13 20:22:50 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:49 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:50 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-unplugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:50 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=32 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:22:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:50 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:50 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] Creating event network-vif-unplugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:22:50 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028687 Apr 13 20:22:50 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 95/288] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:51 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1f12a1e0-7798-4b4d-8249-44b92ac09e33 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1536 microversion: 2.1 time: 0.178761 Apr 13 20:22:51 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 97/289] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:51 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1536 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:22:52 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:22:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}, {"name": "network-changed", "server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:53 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cbfa14567af452db21cb0022514773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed651e141447b995ccae680f1f3681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:22:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a6656ea4-8933-457b-9a64-ffde8b286dd2 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f" status: 200 len: 1495 microversion: 2.1 time: 0.156772 Apr 13 20:22:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 98/290] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:22:52 2023] GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f => generated 1495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:22:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:22:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Creating event network-changed:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:22:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.067500 Apr 13 20:22:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 96/291] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:22:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064092 Apr 13 20:22:56 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 98/292] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:22:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:22:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:22:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:22:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:22:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:22:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033717 Apr 13 20:22:58 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 99/293] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:22:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-plugged", "status": "completed", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] Creating event network-vif-plugged:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:23:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050657 Apr 13 20:23:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 97/294] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:03 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-plugged", "status": "completed", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] Creating event network-vif-plugged:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:23:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044879 Apr 13 20:23:03 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 99/295] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] HTTP exception thrown: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Request method failure captured: Apr 13 20:23:12 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f HTTP/1.1 Apr 13 20:23:12 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:23:12 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:23:12 user devstack@n-api.service[61653]: Connection: close Apr 13 20:23:12 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:23:12 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:23:12 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:23:12 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:23:12 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOoODDCEalkRnBio-1ZFoStx5HadJ0VYHkqVTOgT3ECgtK4oPIXER-FwyqbUDHcfljv7gwIUN0OvQ5J6jCK6jsJ_5Ziy1c4eCk1Wxi-tbJ8wDq7YmCjVMWv4JWDjuoqxEoeV5Zlep7BQyyWWjNg0CHrF2UblAJk3txO7Hn9s65joxg Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Project-Id: 10892937e6784f7bab0a6e5d835f9009 Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Project-Name: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10892937e6784f7bab0a6e5d835f9009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/10892937e6784f7bab0a6e5d835f9009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10892937e6784f7bab0a6e5d835f9009"}]}] Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Tenant: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Tenant-Id: 10892937e6784f7bab0a6e5d835f9009 Apr 13 20:23:12 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:12 user devstack@n-api.service[61653]: X-User: tempest-TaggedAttachmentsTest-1082822260-project-member Apr 13 20:23:12 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:23:12 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:23:12 user devstack@n-api.service[61653]: X-User-Id: 4274e07dcb15438689444331f895ca18 Apr 13 20:23:12 user devstack@n-api.service[61653]: X-User-Name: tempest-TaggedAttachmentsTest-1082822260-project-member Apr 13 20:23:12 user devstack@n-api.service[61653]: method: > Apr 13 20:23:12 user devstack@n-api.service[61653]: exception: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:12 user devstack@n-api.service[61653]: action_args: {'id': 'a78111f4-fcd5-4efc-977e-d8d32225c83f'} Apr 13 20:23:12 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:12 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Returning 404 to user: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-079bcf7c-be43-49de-a4b9-81e52e7a4b9e tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f" status: 404 len: 111 microversion: 2.49 time: 0.043482 Apr 13 20:23:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 100/296] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:23:12 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:23:12 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-165a3f61-3210-4b87-a7d7-3404e6014f31 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '.version_select at 0x7f783816ff40>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:12 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=5 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:12 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=33 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:12 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-165a3f61-3210-4b87-a7d7-3404e6014f31 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-407107657" status: 204 len: 0 microversion: 2.49 time: 0.174049 Apr 13 20:23:12 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 98/297] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 20:23:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-407107657 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:23:14 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=7 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:14 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:SELECT=46,nova_cell1:INSERT=5 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:14 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] HTTP exception thrown: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Request method failure captured: Apr 13 20:23:14 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f HTTP/1.1 Apr 13 20:23:14 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:23:14 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:23:14 user devstack@n-api.service[61653]: Connection: close Apr 13 20:23:14 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:23:14 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:23:14 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:23:14 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:23:14 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOoODDCEalkRnBio-1ZFoStx5HadJ0VYHkqVTOgT3ECgtK4oPIXER-FwyqbUDHcfljv7gwIUN0OvQ5J6jCK6jsJ_5Ziy1c4eCk1Wxi-tbJ8wDq7YmCjVMWv4JWDjuoqxEoeV5Zlep7BQyyWWjNg0CHrF2UblAJk3txO7Hn9s65joxg Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Project-Id: 10892937e6784f7bab0a6e5d835f9009 Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Project-Name: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10892937e6784f7bab0a6e5d835f9009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/10892937e6784f7bab0a6e5d835f9009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10892937e6784f7bab0a6e5d835f9009"}]}] Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Tenant: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Tenant-Id: 10892937e6784f7bab0a6e5d835f9009 Apr 13 20:23:14 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:14 user devstack@n-api.service[61653]: X-User: tempest-TaggedAttachmentsTest-1082822260-project-member Apr 13 20:23:14 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:23:14 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:23:14 user devstack@n-api.service[61653]: X-User-Id: 4274e07dcb15438689444331f895ca18 Apr 13 20:23:14 user devstack@n-api.service[61653]: X-User-Name: tempest-TaggedAttachmentsTest-1082822260-project-member Apr 13 20:23:14 user devstack@n-api.service[61653]: method: > Apr 13 20:23:14 user devstack@n-api.service[61653]: exception: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61653]: action_args: {'id': 'a78111f4-fcd5-4efc-977e-d8d32225c83f'} Apr 13 20:23:14 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Returning 404 to user: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:14 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-71dd4ad1-53d9-4220-9361-f3706216ee21 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f" status: 404 len: 111 microversion: 2.49 time: 0.048849 Apr 13 20:23:14 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 101/298] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:23:14 2023] DELETE /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] HTTP exception thrown: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Request method failure captured: Apr 13 20:23:14 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f HTTP/1.1 Apr 13 20:23:14 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:23:14 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:23:14 user devstack@n-api.service[61654]: Connection: close Apr 13 20:23:14 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:23:14 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:23:14 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:23:14 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:23:14 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGOoODDCEalkRnBio-1ZFoStx5HadJ0VYHkqVTOgT3ECgtK4oPIXER-FwyqbUDHcfljv7gwIUN0OvQ5J6jCK6jsJ_5Ziy1c4eCk1Wxi-tbJ8wDq7YmCjVMWv4JWDjuoqxEoeV5Zlep7BQyyWWjNg0CHrF2UblAJk3txO7Hn9s65joxg Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Project-Id: 10892937e6784f7bab0a6e5d835f9009 Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Project-Name: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10892937e6784f7bab0a6e5d835f9009"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/10892937e6784f7bab0a6e5d835f9009"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/10892937e6784f7bab0a6e5d835f9009"}]}] Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Tenant: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Tenant-Id: 10892937e6784f7bab0a6e5d835f9009 Apr 13 20:23:14 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1082822260 Apr 13 20:23:14 user devstack@n-api.service[61654]: X-User: tempest-TaggedAttachmentsTest-1082822260-project-member Apr 13 20:23:14 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:23:14 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:23:14 user devstack@n-api.service[61654]: X-User-Id: 4274e07dcb15438689444331f895ca18 Apr 13 20:23:14 user devstack@n-api.service[61654]: X-User-Name: tempest-TaggedAttachmentsTest-1082822260-project-member Apr 13 20:23:14 user devstack@n-api.service[61654]: method: > Apr 13 20:23:14 user devstack@n-api.service[61654]: exception: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61654]: action_args: {'id': 'a78111f4-fcd5-4efc-977e-d8d32225c83f'} Apr 13 20:23:14 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. Apr 13 20:23:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Returning 404 to user: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-1da85233-0c08-4bec-950d-0f6c181b87ba tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f" status: 404 len: 111 microversion: 2.49 time: 0.036485 Apr 13 20:23:14 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 99/299] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:23:14 2023] GET /compute/v2.1/servers/a78111f4-fcd5-4efc-977e-d8d32225c83f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:23:14 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1107246113", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:14 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] validate_networks() for [('a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Getting quotas for project 376fa6e005894aee80e4398704d956a7. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Getting quotas for user e39152c6dfed4218aa473532c49844ff and project 376fa6e005894aee80e4398704d956a7. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:23:15 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:23:15 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.870087 Apr 13 20:23:15 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 100/300] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:23:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:23:15 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a8d40c62-1b6d-4af9-b290-85e56c216307 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:15 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a8d40c62-1b6d-4af9-b290-85e56c216307 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:15 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-a8d40c62-1b6d-4af9-b290-85e56c216307 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:23:15 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a8d40c62-1b6d-4af9-b290-85e56c216307 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 200 len: 1211 microversion: 2.1 time: 0.080631 Apr 13 20:23:15 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 102/301] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:23:15 2023] GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:17 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] HTTP exception thrown: Instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 could not be found. Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Request method failure captured: Apr 13 20:23:17 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38 HTTP/1.1 Apr 13 20:23:17 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:23:17 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:23:17 user devstack@n-api.service[61654]: Connection: close Apr 13 20:23:17 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:23:17 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:23:17 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:23:17 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:23:17 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGQRpdBaVI7KDtP8uKFdVtO3bAT2EqraGw-Kyx-QPHngKlcPbitDRm_NZZ6JqXAMg1WTCyoEz2OOA_SEpA4iHXhFu6Bh3nA4_ed-s80tAvaaDbFM6qwd8JSsJ62FcH9eGQOTqnwMU96sc7uSxGePqcfQ2WxKYZZbDcC0Agwsqx2IoRo Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Project-Id: 7b0fe0b98cb1466db76778e75e76bbc8 Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesNegativeTest-1033466652 Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7b0fe0b98cb1466db76778e75e76bbc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7b0fe0b98cb1466db76778e75e76bbc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7b0fe0b98cb1466db76778e75e76bbc8"}]}] Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesNegativeTest-1033466652 Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Tenant-Id: 7b0fe0b98cb1466db76778e75e76bbc8 Apr 13 20:23:17 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesNegativeTest-1033466652 Apr 13 20:23:17 user devstack@n-api.service[61654]: X-User: tempest-VolumesNegativeTest-1033466652-project-member Apr 13 20:23:17 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:23:17 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:23:17 user devstack@n-api.service[61654]: X-User-Id: be2777ed1017497ba7d96ca9d28e4d0c Apr 13 20:23:17 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesNegativeTest-1033466652-project-member Apr 13 20:23:17 user devstack@n-api.service[61654]: method: > Apr 13 20:23:17 user devstack@n-api.service[61654]: exception: Instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 could not be found. Apr 13 20:23:17 user devstack@n-api.service[61654]: action_args: {'id': '4586f280-bf80-4ec1-b5bd-b51c11dc4d38'} Apr 13 20:23:17 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 could not be found. Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 could not be found. Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 could not be found. Apr 13 20:23:17 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:17 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Returning 404 to user: Instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:17 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6b5f7fdc-63c0-466b-83a2-884f861ba4bb tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38" status: 404 len: 111 microversion: 2.1 time: 0.060689 Apr 13 20:23:17 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 100/302] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:23:17 2023] GET /compute/v2.1/servers/4586f280-bf80-4ec1-b5bd-b51c11dc4d38 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:23:18 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c6121a-c1be-467c-888f-1c42b03f95cf", "tag": "5d781018-f7d5-445e-9d00-55c8ff93194c"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:18 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] Creating event network-changed:5d781018-f7d5-445e-9d00-55c8ff93194c for instance 57c6121a-c1be-467c-888f-1c42b03f95cf on user Apr 13 20:23:18 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039906 Apr 13 20:23:18 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 101/303] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:20 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c6121a-c1be-467c-888f-1c42b03f95cf", "name": "network-vif-plugged", "status": "completed", "tag": "5d781018-f7d5-445e-9d00-55c8ff93194c"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] Creating event network-vif-plugged:5d781018-f7d5-445e-9d00-55c8ff93194c for instance 57c6121a-c1be-467c-888f-1c42b03f95cf on user Apr 13 20:23:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044567 Apr 13 20:23:20 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 103/304] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c6121a-c1be-467c-888f-1c42b03f95cf", "name": "network-vif-plugged", "status": "completed", "tag": "5d781018-f7d5-445e-9d00-55c8ff93194c"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] Creating event network-vif-plugged:5d781018-f7d5-445e-9d00-55c8ff93194c for instance 57c6121a-c1be-467c-888f-1c42b03f95cf on user Apr 13 20:23:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039317 Apr 13 20:23:22 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 101/305] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] HTTP exception thrown: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Request method failure captured: Apr 13 20:23:26 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 HTTP/1.1 Apr 13 20:23:26 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:23:26 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:23:26 user devstack@n-api.service[61655]: Connection: close Apr 13 20:23:26 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:23:26 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:23:26 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:23:26 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:23:26 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGOmcf3j2agQ96fQU1RduP30PF2s2CBrSX3TplGmfeFdZnTwsvvtcjzL-NCoXzYB0Zqq-BD0k85pIQCaTnBviuzIN6MVb63FO853zVnPoq7SIfWalXMhIuCO1fEpj9FF4wa4JZ15HIkDathr6WgZU8O7BLenBZmo-o3MykHAIPb8skI Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Project-Id: 9ced32cd96594324b6b8792ef56e28c5 Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Project-Name: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ced32cd96594324b6b8792ef56e28c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ced32cd96594324b6b8792ef56e28c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ced32cd96594324b6b8792ef56e28c5"}]}] Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Tenant: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Tenant-Id: 9ced32cd96594324b6b8792ef56e28c5 Apr 13 20:23:26 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:26 user devstack@n-api.service[61655]: X-User: tempest-TaggedBootDevicesTest-619300676-project-member Apr 13 20:23:26 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:23:26 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:23:26 user devstack@n-api.service[61655]: X-User-Id: 1dc7db2b4cb64d2e9ad08692b248bb18 Apr 13 20:23:26 user devstack@n-api.service[61655]: X-User-Name: tempest-TaggedBootDevicesTest-619300676-project-member Apr 13 20:23:26 user devstack@n-api.service[61655]: method: > Apr 13 20:23:26 user devstack@n-api.service[61655]: exception: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:26 user devstack@n-api.service[61655]: action_args: {'id': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'} Apr 13 20:23:26 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:26 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Returning 404 to user: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1bc5f2ee-3a18-4ce2-8b9e-dfa0e0f4d83b tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 404 len: 111 microversion: 2.32 time: 0.054480 Apr 13 20:23:26 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 102/306] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:23:26 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:23:26 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:26 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1640156d-e242-4dce-96ed-79b871359066 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '.version_select at 0x7f783847f5b0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1640156d-e242-4dce-96ed-79b871359066 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-187606045" status: 204 len: 0 microversion: 2.32 time: 0.040296 Apr 13 20:23:26 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 104/307] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 20:23:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-187606045 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] HTTP exception thrown: Instance da17669c-1ea2-450a-8183-40b47c4f41fc could not be found. Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Request method failure captured: Apr 13 20:23:26 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc HTTP/1.1 Apr 13 20:23:26 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:23:26 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:23:26 user devstack@n-api.service[61654]: Connection: close Apr 13 20:23:26 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:23:26 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:23:26 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:23:26 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:23:26 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGOhzTO0N1yS0iwlm63iJV43fBHreWzkK6sVWtlY_D_AegoOQCZ3FkPpLnE6jmbDskCP4gRP7EZ5fKa3p2pZ2Dt1NbtAFGUhabzkQrjhzW-EG5eFtIqmXVBkRJ3jAvR_BMFi0GDL2lMdf02acY9z64euovcOhzNG-AFyIMePwt00kWU Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Project-Id: 49944b378c2b4e618a631771465a4a9b Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestVolumeSwap-1264222431 Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/49944b378c2b4e618a631771465a4a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/49944b378c2b4e618a631771465a4a9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/49944b378c2b4e618a631771465a4a9b"}]}] Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Tenant: tempest-TestVolumeSwap-1264222431 Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Tenant-Id: 49944b378c2b4e618a631771465a4a9b Apr 13 20:23:26 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestVolumeSwap-1264222431 Apr 13 20:23:26 user devstack@n-api.service[61654]: X-User: tempest-TestVolumeSwap-1264222431-project-member Apr 13 20:23:26 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:23:26 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:23:26 user devstack@n-api.service[61654]: X-User-Id: 195c6c0bc1ec4796b5c1e2ba88c7534a Apr 13 20:23:26 user devstack@n-api.service[61654]: X-User-Name: tempest-TestVolumeSwap-1264222431-project-member Apr 13 20:23:26 user devstack@n-api.service[61654]: method: > Apr 13 20:23:26 user devstack@n-api.service[61654]: exception: Instance da17669c-1ea2-450a-8183-40b47c4f41fc could not be found. Apr 13 20:23:26 user devstack@n-api.service[61654]: action_args: {'id': 'da17669c-1ea2-450a-8183-40b47c4f41fc'} Apr 13 20:23:26 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da17669c-1ea2-450a-8183-40b47c4f41fc could not be found. Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da17669c-1ea2-450a-8183-40b47c4f41fc could not be found. Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da17669c-1ea2-450a-8183-40b47c4f41fc could not be found. Apr 13 20:23:26 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:26 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Returning 404 to user: Instance da17669c-1ea2-450a-8183-40b47c4f41fc could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-fbb5c94f-a223-4721-beb7-f843ee37e623 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc" status: 404 len: 111 microversion: 2.1 time: 0.037943 Apr 13 20:23:26 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 102/308] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:23:26 2023] GET /compute/v2.1/servers/da17669c-1ea2-450a-8183-40b47c4f41fc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:23:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a39fdfe0-614e-4356-a380-b8b3e1ab44c8 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Calling method '.version_select at 0x7f7838135360>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a39fdfe0-614e-4356-a380-b8b3e1ab44c8 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666630945" status: 202 len: 0 microversion: 2.1 time: 0.025279 Apr 13 20:23:26 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 103/309] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 20:23:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666630945 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:29 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] HTTP exception thrown: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Request method failure captured: Apr 13 20:23:29 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 HTTP/1.1 Apr 13 20:23:29 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:23:29 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:23:29 user devstack@n-api.service[61653]: Connection: close Apr 13 20:23:29 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:23:29 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:23:29 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:23:29 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:23:29 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOmcf3j2agQ96fQU1RduP30PF2s2CBrSX3TplGmfeFdZnTwsvvtcjzL-NCoXzYB0Zqq-BD0k85pIQCaTnBviuzIN6MVb63FO853zVnPoq7SIfWalXMhIuCO1fEpj9FF4wa4JZ15HIkDathr6WgZU8O7BLenBZmo-o3MykHAIPb8skI Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Project-Id: 9ced32cd96594324b6b8792ef56e28c5 Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Project-Name: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ced32cd96594324b6b8792ef56e28c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ced32cd96594324b6b8792ef56e28c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ced32cd96594324b6b8792ef56e28c5"}]}] Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Tenant: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Tenant-Id: 9ced32cd96594324b6b8792ef56e28c5 Apr 13 20:23:29 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:29 user devstack@n-api.service[61653]: X-User: tempest-TaggedBootDevicesTest-619300676-project-member Apr 13 20:23:29 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:23:29 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:23:29 user devstack@n-api.service[61653]: X-User-Id: 1dc7db2b4cb64d2e9ad08692b248bb18 Apr 13 20:23:29 user devstack@n-api.service[61653]: X-User-Name: tempest-TaggedBootDevicesTest-619300676-project-member Apr 13 20:23:29 user devstack@n-api.service[61653]: method: > Apr 13 20:23:29 user devstack@n-api.service[61653]: exception: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61653]: action_args: {'id': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'} Apr 13 20:23:29 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Returning 404 to user: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:29 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-12a08f33-5ebd-42f1-b735-5f8e4347d228 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 404 len: 111 microversion: 2.32 time: 0.038588 Apr 13 20:23:29 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 105/310] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:23:29 2023] DELETE /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] HTTP exception thrown: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Request method failure captured: Apr 13 20:23:29 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 HTTP/1.1 Apr 13 20:23:29 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:23:29 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:23:29 user devstack@n-api.service[61654]: Connection: close Apr 13 20:23:29 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:23:29 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:23:29 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:23:29 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:23:29 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGOmcf3j2agQ96fQU1RduP30PF2s2CBrSX3TplGmfeFdZnTwsvvtcjzL-NCoXzYB0Zqq-BD0k85pIQCaTnBviuzIN6MVb63FO853zVnPoq7SIfWalXMhIuCO1fEpj9FF4wa4JZ15HIkDathr6WgZU8O7BLenBZmo-o3MykHAIPb8skI Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Project-Id: 9ced32cd96594324b6b8792ef56e28c5 Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Project-Name: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ced32cd96594324b6b8792ef56e28c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ced32cd96594324b6b8792ef56e28c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ced32cd96594324b6b8792ef56e28c5"}]}] Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Tenant: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Tenant-Id: 9ced32cd96594324b6b8792ef56e28c5 Apr 13 20:23:29 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TaggedBootDevicesTest-619300676 Apr 13 20:23:29 user devstack@n-api.service[61654]: X-User: tempest-TaggedBootDevicesTest-619300676-project-member Apr 13 20:23:29 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:23:29 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:23:29 user devstack@n-api.service[61654]: X-User-Id: 1dc7db2b4cb64d2e9ad08692b248bb18 Apr 13 20:23:29 user devstack@n-api.service[61654]: X-User-Name: tempest-TaggedBootDevicesTest-619300676-project-member Apr 13 20:23:29 user devstack@n-api.service[61654]: method: > Apr 13 20:23:29 user devstack@n-api.service[61654]: exception: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61654]: action_args: {'id': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'} Apr 13 20:23:29 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. Apr 13 20:23:29 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Returning 404 to user: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9ba2026c-ba44-4273-93f3-3482a87b1568 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872" status: 404 len: 111 microversion: 2.32 time: 0.035689 Apr 13 20:23:29 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 103/311] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:23:29 2023] GET /compute/v2.1/servers/8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:23:34 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:23:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-72232b1d-530a-4c04-9f9d-831c5643d0f1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 200 len: 1784 microversion: 2.20 time: 0.351280 Apr 13 20:23:34 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 104/312] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:23:34 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 1784 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:23:35 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1930901382", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:35 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] validate_networks() for [('fcb01a90-9ce8-48cc-af1d-862288650760', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting quotas for project 89f747e06fa64492af3195a88e527bb3. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting quotas for user c89de9f7e5014fa8b0ff7b808bedfb91 and project 89f747e06fa64492af3195a88e527bb3. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:23:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.950146 Apr 13 20:23:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 106/313] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:23:35 2023] POST /compute/v2.1/servers => generated 381 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:23:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2b1f70f0-b456-4365-8899-2382792bbcba tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:36 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-2b1f70f0-b456-4365-8899-2382792bbcba tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:36 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-2b1f70f0-b456-4365-8899-2382792bbcba tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:23:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2b1f70f0-b456-4365-8899-2382792bbcba tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 200 len: 1216 microversion: 2.1 time: 0.180205 Apr 13 20:23:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 104/314] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:23:36 2023] GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:23:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1131214979", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:36 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] validate_networks() for [('fcb01a90-9ce8-48cc-af1d-862288650760', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-71ee2c77-aab5-4df6-ba3b-93a3c19765e3 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079462 Apr 13 20:23:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 107/315] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:23:36 2023] GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting quotas for project 89f747e06fa64492af3195a88e527bb3. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting quotas for user c89de9f7e5014fa8b0ff7b808bedfb91 and project 89f747e06fa64492af3195a88e527bb3. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:23:37 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:23:37 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.854431 Apr 13 20:23:37 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 105/316] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:23:36 2023] POST /compute/v2.1/servers => generated 381 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:23:37 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ff476b30-74a7-45a8-ba50-196d4053cf59 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:37 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ff476b30-74a7-45a8-ba50-196d4053cf59 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:37 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ff476b30-74a7-45a8-ba50-196d4053cf59 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:23:37 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ff476b30-74a7-45a8-ba50-196d4053cf59 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58" status: 200 len: 1216 microversion: 2.1 time: 0.139021 Apr 13 20:23:37 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 105/317] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:23:37 2023] GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58 => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:23:39 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:39 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] Creating event network-changed:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:23:39 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043788 Apr 13 20:23:39 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 108/318] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:40 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=10 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] Creating event network-changed:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:23:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034544 Apr 13 20:23:40 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 106/319] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:40 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb2df6092c342e0b0f44c37abb4a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3042be539b4749b37156c0e5a9d907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:23:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8ec1a9d1-5322-47f4-aa81-f56ffe475399 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 200 len: 1704 microversion: 2.1 time: 0.499498 Apr 13 20:23:41 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 106/320] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:23:40 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 1704 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:23:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-2010973266"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:41 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/action" status: 202 len: 0 microversion: 2.1 time: 1.084237 Apr 13 20:23:42 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 109/321] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:23:41 2023] POST /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/action => generated 0 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 20:23:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:23:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041842 Apr 13 20:23:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 107/322] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-plugged", "status": "completed", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] Creating event network-vif-plugged:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:23:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055917 Apr 13 20:23:44 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 107/323] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:45 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:45 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:23:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073210 Apr 13 20:23:45 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 110/324] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-plugged", "status": "completed", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] Creating event network-vif-plugged:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:23:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066853 Apr 13 20:23:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 108/325] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=23 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a8d63c5d-6d3e-4ae8-bd23-493095c3dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.701052 Apr 13 20:23:52 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 108/326] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:23:51 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/os-interface => generated 282 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:54 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:54 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] Creating event network-changed:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:23:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051750 Apr 13 20:23:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 111/327] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:54 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-1e30654d-f9d5-4ecd-a65c-a68e9298ea47 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/ips" status: 200 len: 104 microversion: 2.1 time: 0.080400 Apr 13 20:23:54 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 109/328] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:23:54 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/ips => generated 104 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1024576911", "imageRef": "0a3095d4-082a-4c70-84d0-8daaa3d5d513", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1904080569", "security_groups": [{"name": "tempest-secgroup-smoke-1161859881"}], "networks": [{"uuid": "2e78e6b2-a44b-40bd-a389-7c280074091d"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] validate_networks() for [('2e78e6b2-a44b-40bd-a389-7c280074091d', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting quotas for project d32350a5bf9a4d8b80c6bc1708387d1f. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting quotas for user 29ed39378db34acd835d13c0cacad399 and project d32350a5bf9a4d8b80c6bc1708387d1f. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:23:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0a3095d4-082a-4c70-84d0-8daaa3d5d513',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:23:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.746186 Apr 13 20:23:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 109/329] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:23:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:23:55 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-768088ca-736f-40fe-9aab-d93891f9017c tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:55 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-768088ca-736f-40fe-9aab-d93891f9017c tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:56 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-768088ca-736f-40fe-9aab-d93891f9017c tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:23:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-768088ca-736f-40fe-9aab-d93891f9017c tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048" status: 200 len: 1237 microversion: 2.1 time: 0.431776 Apr 13 20:23:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 112/330] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:23:55 2023] GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048 => generated 1237 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "58ff638b-c189-4f54-8c46-b1a3614844df"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] HTTP exception thrown: Volume 508bc481-c611-4980-b605-69089c063901 could not be found. Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Request method failure captured: Apr 13 20:23:56 user devstack@n-api.service[61654]: request: PUT /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f/os-volume_attachments/508bc481-c611-4980-b605-69089c063901 HTTP/1.1 Apr 13 20:23:56 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:23:56 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:23:56 user devstack@n-api.service[61654]: Connection: close Apr 13 20:23:56 user devstack@n-api.service[61654]: Content-Length: 74 Apr 13 20:23:56 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:23:56 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:23:56 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:23:56 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGO3rfeSd4tKEmV3dOGfOttyci5E3dKzDyJdpEYOIPZVGu9EM7Z5DbEZm07TVaizD3Crv2HGopYw71xNp7K57Jp2hcWuZ7OfrScMdhcPlILSTyFsLXwSWQ8yv0eg6kL97QOfjN0siXhljGtsbIduOlg3G2iIFcckY1sx695sEygRP-A Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Project-Id: a38a59e4a764409aa351b19c4797b7ad Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesAdminNegativeTest-853684236 Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Role: admin,reader,member Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Roles: admin,reader,member Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a38a59e4a764409aa351b19c4797b7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a38a59e4a764409aa351b19c4797b7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a38a59e4a764409aa351b19c4797b7ad"}]}] Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesAdminNegativeTest-853684236 Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Tenant-Id: a38a59e4a764409aa351b19c4797b7ad Apr 13 20:23:56 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-853684236 Apr 13 20:23:56 user devstack@n-api.service[61654]: X-User: tempest-VolumesAdminNegativeTest-853684236-project-admin Apr 13 20:23:56 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:23:56 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:23:56 user devstack@n-api.service[61654]: X-User-Id: a8623dfa03f64497aca285e4983766e6 Apr 13 20:23:56 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesAdminNegativeTest-853684236-project-admin Apr 13 20:23:56 user devstack@n-api.service[61654]: Apr 13 20:23:56 user devstack@n-api.service[61654]: {"volumeAttachment": {"volumeId": "58ff638b-c189-4f54-8c46-b1a3614844df"}} Apr 13 20:23:56 user devstack@n-api.service[61654]: method: > Apr 13 20:23:56 user devstack@n-api.service[61654]: exception: Volume 508bc481-c611-4980-b605-69089c063901 could not be found. Apr 13 20:23:56 user devstack@n-api.service[61654]: action_args: {'server_id': '66835d12-d155-4684-a9f0-41587936af9f', 'id': '508bc481-c611-4980-b605-69089c063901', 'body': {'volumeAttachment': {'volumeId': '58ff638b-c189-4f54-8c46-b1a3614844df'}}} Apr 13 20:23:56 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 508bc481-c611-4980-b605-69089c063901 could not be found. (HTTP 404) (Request-ID: req-1e97cd69-f4c4-499b-a59e-1dd430c2587a) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 508bc481-c611-4980-b605-69089c063901 could not be found. Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 508bc481-c611-4980-b605-69089c063901 could not be found. Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 508bc481-c611-4980-b605-69089c063901 could not be found. Apr 13 20:23:56 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:23:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] Returning 404 to user: Volume 508bc481-c611-4980-b605-69089c063901 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:23:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-772374c9-a28a-4566-8f12-ee9ad668991a tempest-VolumesAdminNegativeTest-853684236 tempest-VolumesAdminNegativeTest-853684236-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f/os-volume_attachments/508bc481-c611-4980-b605-69089c063901" status: 404 len: 109 microversion: 2.1 time: 0.293493 Apr 13 20:23:56 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 110/331] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 20:23:56 2023] PUT /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f/os-volume_attachments/508bc481-c611-4980-b605-69089c063901 => generated 109 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:23:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-5f788851-ae11-4a55-80ff-5db09ac842fb tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'create', calling method: .version_select at 0x7f7838146830>, body: {"keypair": {"name": "tempest-keypair-514913657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:57 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-5f788851-ae11-4a55-80ff-5db09ac842fb tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:23:57 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-5f788851-ae11-4a55-80ff-5db09ac842fb tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for user 04d351d2822a460d93748b98161d730c and project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:23:57 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aa89e26-6353-427a-a9ef-10c96effef8e"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:23:57 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-5f788851-ae11-4a55-80ff-5db09ac842fb tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147124 Apr 13 20:23:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 110/332] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:23:56 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447220 Apr 13 20:23:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 113/333] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:23:57 2023] POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:23:59 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:24:00 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f" status: 204 len: 0 microversion: 2.1 time: 0.291839 Apr 13 20:24:00 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 111/334] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:23:59 2023] DELETE /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:00 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cbfa14567af452db21cb0022514773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed651e141447b995ccae680f1f3681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:00 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ae29c536-79c7-4ad1-9895-f47561ed7a73 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f" status: 200 len: 1501 microversion: 2.1 time: 0.310717 Apr 13 20:24:00 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 111/335] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:00 2023] GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:00 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-80955434", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7ed2080d-9ecb-4275-aacd-107663b5cf3a"}], "security_groups": [{"name": "tempest-securitygroup--1585673111"}], "key_name": "tempest-keypair-514913657", "user_data": "}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66835d12-d155-4684-a9f0-41587936af9f", "name": "network-vif-unplugged", "status": "completed", "tag": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] Creating event network-vif-unplugged:96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance 66835d12-d155-4684-a9f0-41587936af9f on user Apr 13 20:24:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037937 Apr 13 20:24:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 112/336] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:01 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] validate_networks() for [('7ed2080d-9ecb-4275-aacd-107663b5cf3a', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:24:01 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae3eea8-5d28-46eb-8e84-86958032a048", "tag": "4c29a89c-5e3a-42f4-a315-8c579dc498ea"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] Creating event network-changed:4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 on user Apr 13 20:24:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341554 Apr 13 20:24:01 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 112/337] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:24:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-70c6fdac-f1f6-4a95-b0b3-35ea6dd4e539 req-da624f8e-5ec7-454c-8896-8ae6dd0c9aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66835d12-d155-4684-a9f0-41587936af9f", "name": "network-vif-deleted", "tag": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-70c6fdac-f1f6-4a95-b0b3-35ea6dd4e539 req-da624f8e-5ec7-454c-8896-8ae6dd0c9aba service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-70c6fdac-f1f6-4a95-b0b3-35ea6dd4e539 req-da624f8e-5ec7-454c-8896-8ae6dd0c9aba service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-70c6fdac-f1f6-4a95-b0b3-35ea6dd4e539 req-da624f8e-5ec7-454c-8896-8ae6dd0c9aba service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-70c6fdac-f1f6-4a95-b0b3-35ea6dd4e539 req-da624f8e-5ec7-454c-8896-8ae6dd0c9aba service nova] Creating event network-vif-deleted:96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance 66835d12-d155-4684-a9f0-41587936af9f on user Apr 13 20:24:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-70c6fdac-f1f6-4a95-b0b3-35ea6dd4e539 req-da624f8e-5ec7-454c-8896-8ae6dd0c9aba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180967 Apr 13 20:24:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 113/338] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for user 04d351d2822a460d93748b98161d730c and project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:24:02 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:24:02 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.638687 Apr 13 20:24:02 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 114/339] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:24:00 2023] POST /compute/v2.1/servers => generated 407 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:24:02 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8da0e1c1-1ec2-4ddc-82f7-2b098244dab0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:02 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8da0e1c1-1ec2-4ddc-82f7-2b098244dab0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:02 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-8da0e1c1-1ec2-4ddc-82f7-2b098244dab0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:02 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8da0e1c1-1ec2-4ddc-82f7-2b098244dab0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1230 microversion: 2.1 time: 0.113188 Apr 13 20:24:02 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 113/340] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:02 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1230 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:02 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66835d12-d155-4684-a9f0-41587936af9f", "name": "network-vif-plugged", "status": "completed", "tag": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:02 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] Creating event network-vif-plugged:96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance 66835d12-d155-4684-a9f0-41587936af9f on user Apr 13 20:24:02 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037091 Apr 13 20:24:02 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 114/341] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae3eea8-5d28-46eb-8e84-86958032a048", "name": "network-vif-plugged", "status": "completed", "tag": "4c29a89c-5e3a-42f4-a315-8c579dc498ea"}, {"server_uuid": "5ae3eea8-5d28-46eb-8e84-86958032a048", "name": "network-vif-plugged", "status": "completed", "tag": "4c29a89c-5e3a-42f4-a315-8c579dc498ea"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Creating event network-vif-plugged:4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 on user Apr 13 20:24:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Creating event network-vif-plugged:4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 on user Apr 13 20:24:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033850 Apr 13 20:24:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:05 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:05 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9a05e50a-b6b7-4c04-92a2-dceef282fe68 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: .version_select at 0x7f78381cf2e0>, body: {"keypair": {"name": "tempest-keypair-460582492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdjoDiR1/sxa22KQXzCamjjsrRTyiAOJ2BXVbr3VKtptw//6iZxUKXiHIuassm+TSllT76mN0mTCLuZjyyqQw92kfnNawKIbveVY+nl2cPGP5yLSaDV6Jq9V6tpSU1rkQ=="}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:05 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-f5301262-54cb-4c24-8e0b-a22f1a55d435 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 200 len: 1494 microversion: 2.1 time: 0.243762 Apr 13 20:24:05 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 114/343] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:05 2023] GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 1494 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:05 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-9a05e50a-b6b7-4c04-92a2-dceef282fe68 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for project 053f656470d94d2a9140f393bad01000. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:24:05 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-9a05e50a-b6b7-4c04-92a2-dceef282fe68 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for user 49383d6f0e7141548370d8bc3b96dfd9 and project 053f656470d94d2a9140f393bad01000. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:24:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9a05e50a-b6b7-4c04-92a2-dceef282fe68 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125146 Apr 13 20:24:05 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 115/344] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:24:05 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:06 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] Creating event network-changed:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:24:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039221 Apr 13 20:24:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 116/345] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2073344445", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4a18c4c0-217f-4ba3-96d6-c37b108efca9"}], "security_groups": [{"name": "tempest-securitygroup--1695233150"}], "key_name": "tempest-keypair-460582492", "user_data": "}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] validate_networks() for [('4a18c4c0-217f-4ba3-96d6-c37b108efca9', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:24:07 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:07 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Going to try to stop instance {{(pid=61654) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 20:24:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/action" status: 202 len: 0 microversion: 2.1 time: 0.116251 Apr 13 20:24:07 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 116/346] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:24:07 2023] POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:24:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:07 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for project 053f656470d94d2a9140f393bad01000. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for user 49383d6f0e7141548370d8bc3b96dfd9 and project 053f656470d94d2a9140f393bad01000. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:24:07 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:24:08 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0cca9c24-884c-46ae-9f50-28328bb7956c tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1710 microversion: 2.1 time: 0.179783 Apr 13 20:24:08 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 117/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:07 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1710 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.613817 Apr 13 20:24:08 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 115/348] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:24:07 2023] POST /compute/v2.1/servers => generated 400 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:24:08 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a448a1d0-8acb-402e-9571-2e1796a826f5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:08 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a448a1d0-8acb-402e-9571-2e1796a826f5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:08 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-a448a1d0-8acb-402e-9571-2e1796a826f5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:08 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a448a1d0-8acb-402e-9571-2e1796a826f5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b" status: 200 len: 1235 microversion: 2.1 time: 0.085820 Apr 13 20:24:08 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:08 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b => generated 1235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:08 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-unplugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}, {"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Creating event network-vif-unplugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:24:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:24:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030536 Apr 13 20:24:08 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 118/350] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:08 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:24:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049392 Apr 13 20:24:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 116/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:11 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a369e185-3d75-4dde-8e8a-0e397aab892b", "tag": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:11 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] Creating event network-changed:d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance a369e185-3d75-4dde-8e8a-0e397aab892b on user Apr 13 20:24:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030700 Apr 13 20:24:11 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:11 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:24:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041312 Apr 13 20:24:11 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 119/353] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a369e185-3d75-4dde-8e8a-0e397aab892b", "name": "network-vif-plugged", "status": "completed", "tag": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] Creating event network-vif-plugged:d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance a369e185-3d75-4dde-8e8a-0e397aab892b on user Apr 13 20:24:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036428 Apr 13 20:24:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 117/354] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:15 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a369e185-3d75-4dde-8e8a-0e397aab892b", "name": "network-vif-plugged", "status": "completed", "tag": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] Creating event network-vif-plugged:d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance a369e185-3d75-4dde-8e8a-0e397aab892b on user Apr 13 20:24:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032843 Apr 13 20:24:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:27 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:27 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-9936f49b-4385-43b1-8aa4-3673b9cf313e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58" status: 200 len: 1505 microversion: 2.1 time: 0.173740 Apr 13 20:24:27 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 120/356] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:27 2023] GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=18 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=25 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-44a381a0-f03f-49d3-91c9-24a9f6955fbb tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments/1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c" status: 200 len: 194 microversion: 2.20 time: 0.211200 Apr 13 20:24:34 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 118/357] 10.0.0.210 () {64 vars in 1531 bytes} [Thu Apr 13 20:24:34 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments/1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c => generated 194 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:34 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'services' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:24:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments/1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c" status: 202 len: 0 microversion: 2.20 time: 0.228081 Apr 13 20:24:35 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 120/358] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 20:24:34 2023] DELETE /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments/1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:24:35 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:35 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:35 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-9db8ba69-5af1-4651-90ba-9231cccbf6bd tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072376 Apr 13 20:24:35 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 121/359] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 20:24:35 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:24:41 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:41 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:41 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "POST /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/action" status: 202 len: 0 microversion: 2.1 time: 0.078981 Apr 13 20:24:41 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 119/360] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:24:41 2023] POST /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:24:41 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:41 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:41 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-549ec3e6-5d34-4b44-afd5-9435d8c63b4b tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.094068 Apr 13 20:24:41 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:24:41 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-interface => generated 283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-unplugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] Creating event network-vif-unplugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:24:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035373 Apr 13 20:24:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 122/362] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] Creating event network-changed:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:24:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034268 Apr 13 20:24:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 120/363] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:24:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052035 Apr 13 20:24:44 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] Creating event network-changed:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:24:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038250 Apr 13 20:24:44 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 123/365] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}, {"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:24:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:24:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041703 Apr 13 20:24:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 121/366] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:46 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-fb0c1400-4d0b-4d48-9ab3-96f9267bab71 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048" status: 200 len: 1539 microversion: 2.1 time: 0.210354 Apr 13 20:24:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:46 2023] GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048 => generated 1539 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:50 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] HTTP exception thrown: Instance 66835d12-d155-4684-a9f0-41587936af9f could not be found. Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Request method failure captured: Apr 13 20:24:50 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f HTTP/1.1 Apr 13 20:24:50 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:24:50 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:24:50 user devstack@n-api.service[61653]: Connection: close Apr 13 20:24:50 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:24:50 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:24:50 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:24:50 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:24:50 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOntxpV-pVvVZgQHdpUWdj0xv514X35G2yL6os_DGUoLXEqTJfIPy9F4K9tocx3XQGhjOolKHMn4mzr0X8ArNl7LpVbDjAXxayKJ5gexNXFfpQEI3Giae8BfJzpgsLKDMePIj8vVlaokIRZ-9b6GD0leI2zIt71ffllA_3hGmFn_vQ Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Project-Id: 41ed651e141447b995ccae680f1f3681 Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Project-Name: tempest-VolumesAdminNegativeTest-1573778134 Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41ed651e141447b995ccae680f1f3681"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41ed651e141447b995ccae680f1f3681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41ed651e141447b995ccae680f1f3681"}]}] Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Tenant: tempest-VolumesAdminNegativeTest-1573778134 Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Tenant-Id: 41ed651e141447b995ccae680f1f3681 Apr 13 20:24:50 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1573778134 Apr 13 20:24:50 user devstack@n-api.service[61653]: X-User: tempest-VolumesAdminNegativeTest-1573778134-project-member Apr 13 20:24:50 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:24:50 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:24:50 user devstack@n-api.service[61653]: X-User-Id: 7cbfa14567af452db21cb0022514773b Apr 13 20:24:50 user devstack@n-api.service[61653]: X-User-Name: tempest-VolumesAdminNegativeTest-1573778134-project-member Apr 13 20:24:50 user devstack@n-api.service[61653]: method: > Apr 13 20:24:50 user devstack@n-api.service[61653]: exception: Instance 66835d12-d155-4684-a9f0-41587936af9f could not be found. Apr 13 20:24:50 user devstack@n-api.service[61653]: action_args: {'id': '66835d12-d155-4684-a9f0-41587936af9f'} Apr 13 20:24:50 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66835d12-d155-4684-a9f0-41587936af9f could not be found. Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66835d12-d155-4684-a9f0-41587936af9f could not be found. Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66835d12-d155-4684-a9f0-41587936af9f could not be found. Apr 13 20:24:50 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:24:50 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Returning 404 to user: Instance 66835d12-d155-4684-a9f0-41587936af9f could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:24:50 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-62fac73a-5fd9-4c7f-8255-bfa276ec2fc7 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f" status: 404 len: 111 microversion: 2.1 time: 0.249597 Apr 13 20:24:50 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 124/368] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:50 2023] GET /compute/v2.1/servers/66835d12-d155-4684-a9f0-41587936af9f => generated 111 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:52 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-753f884d-1213-4c93-98f8-8f8cc34adf66 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1537 microversion: 2.1 time: 0.240429 Apr 13 20:24:52 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 122/369] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:52 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:52 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:53 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:24:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b" status: 204 len: 0 microversion: 2.1 time: 0.255639 Apr 13 20:24:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 124/370] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:24:52 2023] DELETE /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:53 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cbfa14567af452db21cb0022514773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed651e141447b995ccae680f1f3681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-227fab73-ecee-4e02-bf4d-c799aac9f8d5 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b" status: 200 len: 1670 microversion: 2.1 time: 0.422415 Apr 13 20:24:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 125/371] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:53 2023] GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b => generated 1670 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:53 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0136288f-abaf-4a7c-a878-db415ff98f4b", "name": "network-vif-unplugged", "status": "completed", "tag": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] Creating event network-vif-unplugged:11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance 0136288f-abaf-4a7c-a878-db415ff98f4b on user Apr 13 20:24:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094827 Apr 13 20:24:53 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 123/372] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:54 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-ba458b3d-03f1-4ba1-991d-77143553909c req-d5759481-2847-4761-a7df-53bc9370ef32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0136288f-abaf-4a7c-a878-db415ff98f4b", "name": "network-vif-deleted", "tag": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ba458b3d-03f1-4ba1-991d-77143553909c req-d5759481-2847-4761-a7df-53bc9370ef32 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ba458b3d-03f1-4ba1-991d-77143553909c req-d5759481-2847-4761-a7df-53bc9370ef32 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ba458b3d-03f1-4ba1-991d-77143553909c req-d5759481-2847-4761-a7df-53bc9370ef32 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:54 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-ba458b3d-03f1-4ba1-991d-77143553909c req-d5759481-2847-4761-a7df-53bc9370ef32 service nova] Creating event network-vif-deleted:11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance 0136288f-abaf-4a7c-a878-db415ff98f4b on user Apr 13 20:24:54 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-ba458b3d-03f1-4ba1-991d-77143553909c req-d5759481-2847-4761-a7df-53bc9370ef32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038004 Apr 13 20:24:54 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 125/373] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:55 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0136288f-abaf-4a7c-a878-db415ff98f4b", "name": "network-vif-plugged", "status": "completed", "tag": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:24:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:55 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] Creating event network-vif-plugged:11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance 0136288f-abaf-4a7c-a878-db415ff98f4b on user Apr 13 20:24:55 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030046 Apr 13 20:24:55 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 126/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:24:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:24:58 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-54fcb774-58d9-4327-a5b0-1a473012780f tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1687 microversion: 2.1 time: 0.154807 Apr 13 20:24:58 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 124/375] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:58 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:24:58 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:24:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ae39ee40-7e5b-486d-a7a9-9bbf199b1184 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b" status: 200 len: 1544 microversion: 2.1 time: 0.148067 Apr 13 20:24:58 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 126/376] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:24:58 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b => generated 1544 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:25:05 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=14 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:05 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=26 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:05 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1606749477", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba"}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] validate_networks() for [('a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Getting quotas for project 376fa6e005894aee80e4398704d956a7. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Getting quotas for user e39152c6dfed4218aa473532c49844ff and project 376fa6e005894aee80e4398704d956a7. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:25:06 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:25:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.604180 Apr 13 20:25:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 127/377] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:25:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:25:06 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ad4a1951-9651-43ca-86c5-71479a5c784c tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:06 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ad4a1951-9651-43ca-86c5-71479a5c784c tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:06 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=15 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:06 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-ad4a1951-9651-43ca-86c5-71479a5c784c tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:06 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ad4a1951-9651-43ca-86c5-71479a5c784c tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf" status: 200 len: 1211 microversion: 2.1 time: 0.072979 Apr 13 20:25:06 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 125/378] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:25:06 2023] GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf => generated 1211 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:25:09 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f49fca-6bb7-4297-b903-4c4ddbe325cf", "tag": "27e6da64-070b-4a09-8874-138a9490d844"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:09 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:09 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] Creating event network-changed:27e6da64-070b-4a09-8874-138a9490d844 for instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf on user Apr 13 20:25:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050618 Apr 13 20:25:09 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 127/379] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:11 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f49fca-6bb7-4297-b903-4c4ddbe325cf", "name": "network-vif-plugged", "status": "completed", "tag": "27e6da64-070b-4a09-8874-138a9490d844"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] Creating event network-vif-plugged:27e6da64-070b-4a09-8874-138a9490d844 for instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf on user Apr 13 20:25:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051076 Apr 13 20:25:11 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 128/380] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f49fca-6bb7-4297-b903-4c4ddbe325cf", "name": "network-vif-plugged", "status": "completed", "tag": "27e6da64-070b-4a09-8874-138a9490d844"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:13 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] Creating event network-vif-plugged:27e6da64-070b-4a09-8874-138a9490d844 for instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf on user Apr 13 20:25:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031396 Apr 13 20:25:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 126/381] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:13 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:13 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:14 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'services' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:25:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-volume_attachments/73e8450f-52ed-4e90-83e8-1ba72b5e60cb" status: 202 len: 0 microversion: 2.1 time: 0.293840 Apr 13 20:25:14 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 128/382] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:25:13 2023] DELETE /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-volume_attachments/73e8450f-52ed-4e90-83e8-1ba72b5e60cb => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:25:14 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:14 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:14 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-9f11d253-cd18-416f-828f-01964da68bd5 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080735 Apr 13 20:25:14 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 129/383] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:25:14 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=5 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d44232f5-6344-4c25-aa61-0146fd900579 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059989 Apr 13 20:25:25 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 127/384] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 20:25:25 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:25 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:25:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 204 len: 0 microversion: 2.20 time: 0.196279 Apr 13 20:25:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 129/385] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:25:25 2023] DELETE /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=10 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:25 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-47f5ee05-cb7f-494e-a460-0b6e7f1187f9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 200 len: 1712 microversion: 2.20 time: 0.218182 Apr 13 20:25:25 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 130/386] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:25:25 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 1712 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-unplugged", "status": "completed", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] Creating event network-vif-unplugged:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:25:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027401 Apr 13 20:25:25 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 128/387] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-7e37a8ed-e82d-4e1d-86cc-2b47d4ac54fc req-75ad3906-c19e-44b7-bc32-074d8e56b969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-deleted", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7e37a8ed-e82d-4e1d-86cc-2b47d4ac54fc req-75ad3906-c19e-44b7-bc32-074d8e56b969 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7e37a8ed-e82d-4e1d-86cc-2b47d4ac54fc req-75ad3906-c19e-44b7-bc32-074d8e56b969 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7e37a8ed-e82d-4e1d-86cc-2b47d4ac54fc req-75ad3906-c19e-44b7-bc32-074d8e56b969 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-7e37a8ed-e82d-4e1d-86cc-2b47d4ac54fc req-75ad3906-c19e-44b7-bc32-074d8e56b969 service nova] Creating event network-vif-deleted:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:25:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-7e37a8ed-e82d-4e1d-86cc-2b47d4ac54fc req-75ad3906-c19e-44b7-bc32-074d8e56b969 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029549 Apr 13 20:25:27 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 130/388] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:27 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9", "name": "network-vif-plugged", "status": "completed", "tag": "df3a82f9-8c19-424c-a1b3-3332149ac690"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:27 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'flavor' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:25:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:27 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] Creating event network-vif-plugged:df3a82f9-8c19-424c-a1b3-3332149ac690 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 on user Apr 13 20:25:27 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029547 Apr 13 20:25:27 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 129/389] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:27 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58/action" status: 200 len: 32 microversion: 2.1 time: 0.111735 Apr 13 20:25:27 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 131/390] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:25:27 2023] POST /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:28 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-18b9b8fd-9d24-4afc-9489-60bb7a0fb061 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58" status: 200 len: 1511 microversion: 2.1 time: 0.188569 Apr 13 20:25:28 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 131/391] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:25:27 2023] GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58 => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:25:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-unplugged", "status": "completed", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}, {"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-plugged", "status": "completed", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Creating event network-vif-unplugged:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:25:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Creating event network-vif-plugged:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:25:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031035 Apr 13 20:25:29 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 130/392] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:31 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-plugged", "status": "completed", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}, {"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-plugged", "status": "completed", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Creating event network-vif-plugged:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:25:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Creating event network-vif-plugged:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:25:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042161 Apr 13 20:25:31 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 132/393] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] HTTP exception thrown: Instance 0136288f-abaf-4a7c-a878-db415ff98f4b could not be found. Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Request method failure captured: Apr 13 20:25:43 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b HTTP/1.1 Apr 13 20:25:43 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:25:43 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:25:43 user devstack@n-api.service[61654]: Connection: close Apr 13 20:25:43 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:25:43 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:25:43 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:25:43 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:25:43 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGOntxpV-pVvVZgQHdpUWdj0xv514X35G2yL6os_DGUoLXEqTJfIPy9F4K9tocx3XQGhjOolKHMn4mzr0X8ArNl7LpVbDjAXxayKJ5gexNXFfpQEI3Giae8BfJzpgsLKDMePIj8vVlaokIRZ-9b6GD0leI2zIt71ffllA_3hGmFn_vQ Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Project-Id: 41ed651e141447b995ccae680f1f3681 Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesAdminNegativeTest-1573778134 Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41ed651e141447b995ccae680f1f3681"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41ed651e141447b995ccae680f1f3681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41ed651e141447b995ccae680f1f3681"}]}] Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesAdminNegativeTest-1573778134 Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Tenant-Id: 41ed651e141447b995ccae680f1f3681 Apr 13 20:25:43 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1573778134 Apr 13 20:25:43 user devstack@n-api.service[61654]: X-User: tempest-VolumesAdminNegativeTest-1573778134-project-member Apr 13 20:25:43 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:25:43 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:25:43 user devstack@n-api.service[61654]: X-User-Id: 7cbfa14567af452db21cb0022514773b Apr 13 20:25:43 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesAdminNegativeTest-1573778134-project-member Apr 13 20:25:43 user devstack@n-api.service[61654]: method: > Apr 13 20:25:43 user devstack@n-api.service[61654]: exception: Instance 0136288f-abaf-4a7c-a878-db415ff98f4b could not be found. Apr 13 20:25:43 user devstack@n-api.service[61654]: action_args: {'id': '0136288f-abaf-4a7c-a878-db415ff98f4b'} Apr 13 20:25:43 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0136288f-abaf-4a7c-a878-db415ff98f4b could not be found. Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0136288f-abaf-4a7c-a878-db415ff98f4b could not be found. Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0136288f-abaf-4a7c-a878-db415ff98f4b could not be found. Apr 13 20:25:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Returning 404 to user: Instance 0136288f-abaf-4a7c-a878-db415ff98f4b could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:25:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d6afa17d-5156-4403-b350-df36eb66b523 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b" status: 404 len: 111 microversion: 2.1 time: 0.064059 Apr 13 20:25:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 132/394] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:25:43 2023] GET /compute/v2.1/servers/0136288f-abaf-4a7c-a878-db415ff98f4b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:25:43 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=8 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:43 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=14 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8e68f415-7c14-45f9-b3a8-cd7fc970fee4 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Calling method '.version_select at 0x7f783821b910>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8e68f415-7c14-45f9-b3a8-cd7fc970fee4 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052829447" status: 202 len: 0 microversion: 2.1 time: 0.023951 Apr 13 20:25:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 131/395] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 20:25:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052829447 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:46 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6c840c38-4ce6-4da3-b886-b8c33eb337f0 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048" status: 200 len: 1539 microversion: 2.1 time: 0.376852 Apr 13 20:25:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 133/396] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:25:46 2023] GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048 => generated 1539 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:25:48 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae3eea8-5d28-46eb-8e84-86958032a048", "tag": "4c29a89c-5e3a-42f4-a315-8c579dc498ea"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] Creating event network-changed:4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 on user Apr 13 20:25:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031217 Apr 13 20:25:48 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 133/397] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:48 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0db1430-89ec-4825-927c-9462b4963a26"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:48 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:48 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368163 Apr 13 20:25:48 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 132/398] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:25:48 2023] POST /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:52 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a784d164-b4ff-44c8-9997-11d8af90f146 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.128437 Apr 13 20:25:52 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 134/399] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:25:52 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-interface => generated 282 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2f0c4949-390d-412e-9107-9fcbf6893c9a tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Action: 'create', calling method: .version_select at 0x7f7833feaef0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-906726087", "metadata": {"Type": "work"}}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2f0c4949-390d-412e-9107-9fcbf6893c9a tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Request method failure captured: Apr 13 20:25:52 user devstack@n-api.service[61654]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 20:25:52 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:25:52 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:25:52 user devstack@n-api.service[61654]: Connection: close Apr 13 20:25:52 user devstack@n-api.service[61654]: Content-Length: 121 Apr 13 20:25:52 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:25:52 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:25:52 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:25:52 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGVQXvZzjx0xEuWMJihqlwRdxDbCTD23DpP8-5kerTglR-ubNscroYX0Pur8wDxVZ8hD4o2SFiMDN9J9xMH0UgOf_3S9rptCudOVuvUX7vgyN3UpusY3ooWwRPtQHXkWb1-Yvk34Ebf9m8FlRO-uvtsuDUJ2XmJ50yepLlVGMP6BBU8 Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Project-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b426d403d442448ab8770410fc512082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}] Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Tenant-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:52 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:52 user devstack@n-api.service[61654]: X-User: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:52 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:25:52 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:25:52 user devstack@n-api.service[61654]: X-User-Id: 8d7a4a57915f4338b784a7a23119a737 Apr 13 20:25:52 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:52 user devstack@n-api.service[61654]: Apr 13 20:25:52 user devstack@n-api.service[61654]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-906726087", "metadata": {"Type": "work"}}} Apr 13 20:25:52 user devstack@n-api.service[61654]: method: Apr 13 20:25:52 user devstack@n-api.service[61654]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 20:25:52 user devstack@n-api.service[61654]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-906726087', 'metadata': {'Type': 'work'}}}} Apr 13 20:25:52 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise error Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi '#$%' Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 20:25:52 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2f0c4949-390d-412e-9107-9fcbf6893c9a tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:25:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2f0c4949-390d-412e-9107-9fcbf6893c9a tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.188907 Apr 13 20:25:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 134/400] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 20:25:52 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:25:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-92b2527f-3e3c-4707-a203-5965d47160c0 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Action: 'create', calling method: .version_select at 0x7f7838134430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1462390072", "metadata": {"Type": "work"}}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-92b2527f-3e3c-4707-a203-5965d47160c0 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Request method failure captured: Apr 13 20:25:52 user devstack@n-api.service[61655]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 20:25:52 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:25:52 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:25:52 user devstack@n-api.service[61655]: Connection: close Apr 13 20:25:52 user devstack@n-api.service[61655]: Content-Length: 120 Apr 13 20:25:52 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:25:52 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:25:52 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:25:52 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGVQXvZzjx0xEuWMJihqlwRdxDbCTD23DpP8-5kerTglR-ubNscroYX0Pur8wDxVZ8hD4o2SFiMDN9J9xMH0UgOf_3S9rptCudOVuvUX7vgyN3UpusY3ooWwRPtQHXkWb1-Yvk34Ebf9m8FlRO-uvtsuDUJ2XmJ50yepLlVGMP6BBU8 Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Project-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Project-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b426d403d442448ab8770410fc512082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}] Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Tenant: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Tenant-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:52 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:52 user devstack@n-api.service[61655]: X-User: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:52 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:25:52 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:25:52 user devstack@n-api.service[61655]: X-User-Id: 8d7a4a57915f4338b784a7a23119a737 Apr 13 20:25:52 user devstack@n-api.service[61655]: X-User-Name: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:52 user devstack@n-api.service[61655]: Apr 13 20:25:52 user devstack@n-api.service[61655]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1462390072", "metadata": {"Type": "work"}}} Apr 13 20:25:52 user devstack@n-api.service[61655]: method: Apr 13 20:25:52 user devstack@n-api.service[61655]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 20:25:52 user devstack@n-api.service[61655]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1462390072', 'metadata': {'Type': 'work'}}}} Apr 13 20:25:52 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise error Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi '0' Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 20:25:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-92b2527f-3e3c-4707-a203-5965d47160c0 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:25:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-92b2527f-3e3c-4707-a203-5965d47160c0 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018093 Apr 13 20:25:52 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 133/401] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 20:25:52 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1ac99e0f-900b-4d85-8809-e0be09265902 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Action: 'create', calling method: .version_select at 0x7f78381b5750>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1313376590", "metadata": {"Type": "work"}}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1ac99e0f-900b-4d85-8809-e0be09265902 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Request method failure captured: Apr 13 20:25:53 user devstack@n-api.service[61653]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 20:25:53 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:25:53 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:25:53 user devstack@n-api.service[61653]: Connection: close Apr 13 20:25:53 user devstack@n-api.service[61653]: Content-Length: 119 Apr 13 20:25:53 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:25:53 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:25:53 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:25:53 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGVQXvZzjx0xEuWMJihqlwRdxDbCTD23DpP8-5kerTglR-ubNscroYX0Pur8wDxVZ8hD4o2SFiMDN9J9xMH0UgOf_3S9rptCudOVuvUX7vgyN3UpusY3ooWwRPtQHXkWb1-Yvk34Ebf9m8FlRO-uvtsuDUJ2XmJ50yepLlVGMP6BBU8 Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Project-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Project-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b426d403d442448ab8770410fc512082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}] Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Tenant: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Tenant-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:53 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61653]: X-User: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:53 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:25:53 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:25:53 user devstack@n-api.service[61653]: X-User-Id: 8d7a4a57915f4338b784a7a23119a737 Apr 13 20:25:53 user devstack@n-api.service[61653]: X-User-Name: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:53 user devstack@n-api.service[61653]: Apr 13 20:25:53 user devstack@n-api.service[61653]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1313376590", "metadata": {"Type": "work"}}} Apr 13 20:25:53 user devstack@n-api.service[61653]: method: Apr 13 20:25:53 user devstack@n-api.service[61653]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 20:25:53 user devstack@n-api.service[61653]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1313376590', 'metadata': {'Type': 'work'}}}} Apr 13 20:25:53 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise error Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi '' Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 20:25:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1ac99e0f-900b-4d85-8809-e0be09265902 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:25:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1ac99e0f-900b-4d85-8809-e0be09265902 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015069 Apr 13 20:25:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 135/402] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 20:25:53 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6774d4ce-41a3-4e5b-af3c-4a09075d75bd tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Calling method '.version_select at 0x7f783816e560>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-6774d4ce-41a3-4e5b-af3c-4a09075d75bd tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] HTTP exception thrown: Volume tempest-invalid-2099207890 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6774d4ce-41a3-4e5b-af3c-4a09075d75bd tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Request method failure captured: Apr 13 20:25:53 user devstack@n-api.service[61654]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2099207890 HTTP/1.1 Apr 13 20:25:53 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:25:53 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:25:53 user devstack@n-api.service[61654]: Connection: close Apr 13 20:25:53 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:25:53 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:25:53 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:25:53 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:25:53 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGVQXvZzjx0xEuWMJihqlwRdxDbCTD23DpP8-5kerTglR-ubNscroYX0Pur8wDxVZ8hD4o2SFiMDN9J9xMH0UgOf_3S9rptCudOVuvUX7vgyN3UpusY3ooWwRPtQHXkWb1-Yvk34Ebf9m8FlRO-uvtsuDUJ2XmJ50yepLlVGMP6BBU8 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Project-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b426d403d442448ab8770410fc512082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}] Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Tenant-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User-Id: 8d7a4a57915f4338b784a7a23119a737 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:53 user devstack@n-api.service[61654]: method: Apr 13 20:25:53 user devstack@n-api.service[61654]: exception: Volume tempest-invalid-2099207890 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: action_args: {'id': 'tempest-invalid-2099207890'} Apr 13 20:25:53 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2099207890 could not be found. (HTTP 404) (Request-ID: req-3761f2df-451a-4ba4-8734-39988da44b13) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2099207890 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2099207890 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2099207890 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6774d4ce-41a3-4e5b-af3c-4a09075d75bd tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Returning 404 to user: Volume tempest-invalid-2099207890 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:25:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6774d4ce-41a3-4e5b-af3c-4a09075d75bd tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2099207890" status: 404 len: 99 microversion: 2.1 time: 0.037493 Apr 13 20:25:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 135/403] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 20:25:53 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-2099207890 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4760e93f-f3e8-4499-8c12-003f0b919d05 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003458 Apr 13 20:25:53 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 134/404] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 20:25:53 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-07c86dac-95dd-418a-82e9-842293f74a33 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004390 Apr 13 20:25:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 136/405] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 13 20:25:53 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-56f452ea-0aea-445d-b2bb-3511acbb4f53 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Calling method '.version_select at 0x7f7833fe8550>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-56f452ea-0aea-445d-b2bb-3511acbb4f53 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] HTTP exception thrown: Volume 16ec21b0-797a-4ef9-8f5f-b255e4504550 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-56f452ea-0aea-445d-b2bb-3511acbb4f53 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Request method failure captured: Apr 13 20:25:53 user devstack@n-api.service[61654]: request: DELETE /compute/v2.1/os-volumes/16ec21b0-797a-4ef9-8f5f-b255e4504550 HTTP/1.1 Apr 13 20:25:53 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:25:53 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:25:53 user devstack@n-api.service[61654]: Connection: close Apr 13 20:25:53 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:25:53 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:25:53 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:25:53 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:25:53 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGVQXvZzjx0xEuWMJihqlwRdxDbCTD23DpP8-5kerTglR-ubNscroYX0Pur8wDxVZ8hD4o2SFiMDN9J9xMH0UgOf_3S9rptCudOVuvUX7vgyN3UpusY3ooWwRPtQHXkWb1-Yvk34Ebf9m8FlRO-uvtsuDUJ2XmJ50yepLlVGMP6BBU8 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Project-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b426d403d442448ab8770410fc512082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}] Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Tenant-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User-Id: 8d7a4a57915f4338b784a7a23119a737 Apr 13 20:25:53 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:53 user devstack@n-api.service[61654]: method: Apr 13 20:25:53 user devstack@n-api.service[61654]: exception: Volume 16ec21b0-797a-4ef9-8f5f-b255e4504550 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: action_args: {'id': '16ec21b0-797a-4ef9-8f5f-b255e4504550'} Apr 13 20:25:53 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16ec21b0-797a-4ef9-8f5f-b255e4504550 could not be found. (HTTP 404) (Request-ID: req-6afcd9ab-444f-45a4-8340-f115323fb2af) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16ec21b0-797a-4ef9-8f5f-b255e4504550 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16ec21b0-797a-4ef9-8f5f-b255e4504550 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16ec21b0-797a-4ef9-8f5f-b255e4504550 could not be found. Apr 13 20:25:53 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-56f452ea-0aea-445d-b2bb-3511acbb4f53 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Returning 404 to user: Volume 16ec21b0-797a-4ef9-8f5f-b255e4504550 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:25:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-56f452ea-0aea-445d-b2bb-3511acbb4f53 tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/16ec21b0-797a-4ef9-8f5f-b255e4504550" status: 404 len: 109 microversion: 2.1 time: 0.034753 Apr 13 20:25:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 136/406] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:25:53 2023] DELETE /compute/v2.1/os-volumes/16ec21b0-797a-4ef9-8f5f-b255e4504550 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-fd894963-ff7f-4c03-b729-e565bbec360e tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Calling method '.version_select at 0x7f783821a5f0>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-fd894963-ff7f-4c03-b729-e565bbec360e tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] HTTP exception thrown: Volume 5f094ae1-cd88-46f8-a82b-9efcec819bcd could not be found. Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-fd894963-ff7f-4c03-b729-e565bbec360e tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Request method failure captured: Apr 13 20:25:53 user devstack@n-api.service[61655]: request: GET /compute/v2.1/os-volumes/5f094ae1-cd88-46f8-a82b-9efcec819bcd HTTP/1.1 Apr 13 20:25:53 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:25:53 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:25:53 user devstack@n-api.service[61655]: Connection: close Apr 13 20:25:53 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:25:53 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:25:53 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:25:53 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:25:53 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGVQXvZzjx0xEuWMJihqlwRdxDbCTD23DpP8-5kerTglR-ubNscroYX0Pur8wDxVZ8hD4o2SFiMDN9J9xMH0UgOf_3S9rptCudOVuvUX7vgyN3UpusY3ooWwRPtQHXkWb1-Yvk34Ebf9m8FlRO-uvtsuDUJ2XmJ50yepLlVGMP6BBU8 Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Project-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Project-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b426d403d442448ab8770410fc512082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b426d403d442448ab8770410fc512082"}]}] Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Tenant: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Tenant-Id: b426d403d442448ab8770410fc512082 Apr 13 20:25:53 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-VolumesNegativeTest-426487281 Apr 13 20:25:53 user devstack@n-api.service[61655]: X-User: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:53 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:25:53 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:25:53 user devstack@n-api.service[61655]: X-User-Id: 8d7a4a57915f4338b784a7a23119a737 Apr 13 20:25:53 user devstack@n-api.service[61655]: X-User-Name: tempest-VolumesNegativeTest-426487281-project-member Apr 13 20:25:53 user devstack@n-api.service[61655]: method: Apr 13 20:25:53 user devstack@n-api.service[61655]: exception: Volume 5f094ae1-cd88-46f8-a82b-9efcec819bcd could not be found. Apr 13 20:25:53 user devstack@n-api.service[61655]: action_args: {'id': '5f094ae1-cd88-46f8-a82b-9efcec819bcd'} Apr 13 20:25:53 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f094ae1-cd88-46f8-a82b-9efcec819bcd could not be found. (HTTP 404) (Request-ID: req-5bfd6699-58c1-4be3-8049-def89ee6e5c0) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f094ae1-cd88-46f8-a82b-9efcec819bcd could not be found. Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f094ae1-cd88-46f8-a82b-9efcec819bcd could not be found. Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f094ae1-cd88-46f8-a82b-9efcec819bcd could not be found. Apr 13 20:25:53 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-fd894963-ff7f-4c03-b729-e565bbec360e tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] Returning 404 to user: Volume 5f094ae1-cd88-46f8-a82b-9efcec819bcd could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:25:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-fd894963-ff7f-4c03-b729-e565bbec360e tempest-VolumesNegativeTest-426487281 tempest-VolumesNegativeTest-426487281-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5f094ae1-cd88-46f8-a82b-9efcec819bcd" status: 404 len: 109 microversion: 2.1 time: 0.038254 Apr 13 20:25:53 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 135/407] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:25:53 2023] GET /compute/v2.1/os-volumes/5f094ae1-cd88-46f8-a82b-9efcec819bcd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] Creating event network-changed:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:25:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048401 Apr 13 20:25:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:25:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:53 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-bd233f7f-7984-4eb1-960c-1d1a386152d8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1537 microversion: 2.1 time: 0.155714 Apr 13 20:25:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:25:53 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:54 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-37965faf-1e08-470b-a2e7-d99630025d2b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1537 microversion: 2.1 time: 0.246439 Apr 13 20:25:54 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 136/410] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:25:53 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:56 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-777b3fbe-0711-4c95-8828-0f24141f9551 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf" status: 200 len: 1494 microversion: 2.1 time: 0.161423 Apr 13 20:25:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 138/411] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:25:56 2023] GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf => generated 1494 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:25:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:56 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:57 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'services' on Instance uuid 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:25:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048/os-volume_attachments/e0db1430-89ec-4825-927c-9462b4963a26" status: 202 len: 0 microversion: 2.1 time: 0.279656 Apr 13 20:25:57 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 138/412] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:25:56 2023] DELETE /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048/os-volume_attachments/e0db1430-89ec-4825-927c-9462b4963a26 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:25:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:57 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-e83299aa-27a3-4ca8-a797-366b085dccf8 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054404 Apr 13 20:25:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 137/413] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:25:57 2023] GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:25:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:58 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Going to try to start instance {{(pid=61653) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 20:25:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/action" status: 202 len: 0 microversion: 2.1 time: 0.102490 Apr 13 20:25:58 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 139/414] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:25:58 2023] POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:58 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:25:58 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:25:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:25:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:25:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:25:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ce68e984-8992-451c-a850-f24af2b60b69 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.082557 Apr 13 20:25:58 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 138/415] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:25:58 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-interface => generated 282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:25:58 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:25:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-936c5d7e-848d-4c63-a76e-ab0ccd0634d6 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1696 microversion: 2.1 time: 0.151273 Apr 13 20:25:58 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 139/416] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:25:58 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:26:00 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a369e185-3d75-4dde-8e8a-0e397aab892b", "tag": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:00 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:00 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:00 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:00 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] Creating event network-changed:d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance a369e185-3d75-4dde-8e8a-0e397aab892b on user Apr 13 20:26:00 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030838 Apr 13 20:26:00 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 140/417] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:00 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:00 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7325199c-5458-404b-b178-df09d0c1606c tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/ips" status: 200 len: 107 microversion: 2.1 time: 0.034446 Apr 13 20:26:00 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 139/418] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:26:00 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/ips => generated 107 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c609f609-6cab-47d1-85eb-bf8ad9a0a959"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:01 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:01 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:02 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345363 Apr 13 20:26:02 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 140/419] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:26:01 2023] POST /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:03 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:26:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051253 Apr 13 20:26:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 141/420] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:04 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a26eb638-7882-486f-bdab-376f6f825c4a tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047423 Apr 13 20:26:04 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 140/421] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:26:04 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:26:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:26:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038278 Apr 13 20:26:06 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 141/422] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0fcf9491-b294-4e63-a5d9-7fbc02b3274d tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '.version_select at 0x7f78381b56c0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0fcf9491-b294-4e63-a5d9-7fbc02b3274d tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/3acc4cf1-db6f-405d-8695-ddaf35363cfe" status: 204 len: 0 microversion: 2.1 time: 0.238440 Apr 13 20:26:08 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 142/423] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:07 2023] DELETE /compute/v2.1/images/3acc4cf1-db6f-405d-8695-ddaf35363cfe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:08 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:26:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 204 len: 0 microversion: 2.1 time: 0.134704 Apr 13 20:26:08 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 141/424] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:26:08 2023] DELETE /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:08 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb2df6092c342e0b0f44c37abb4a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3042be539b4749b37156c0e5a9d907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:08 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b4b0ffbd-79b8-4945-9544-b1ae02258d80 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 200 len: 1678 microversion: 2.1 time: 0.247867 Apr 13 20:26:08 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 142/425] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:08 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:26:08 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-unplugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] Creating event network-vif-unplugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:26:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090287 Apr 13 20:26:08 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 143/426] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c1376d97-f729-4fc9-bc68-dcef07f5a133 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: .version_select at 0x7f7838135e10>, body: {"keypair": {"name": "tempest-keypair-1549482162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjITfErfI5lYMl/OBfOsCubod6xMYka7P1ow+hjTuaL7Z7vxoMaZ0i9tj7r9D26pmmekOuT/r6BdP2VqLpZ7VwGSf0pHHbaPbZEooTvFfELXkkm7TGz+xl7EPns2IjPgA=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:09 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-c1376d97-f729-4fc9-bc68-dcef07f5a133 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for project 053f656470d94d2a9140f393bad01000. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:26:09 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-c1376d97-f729-4fc9-bc68-dcef07f5a133 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for user 49383d6f0e7141548370d8bc3b96dfd9 and project 053f656470d94d2a9140f393bad01000. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:26:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c1376d97-f729-4fc9-bc68-dcef07f5a133 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049056 Apr 13 20:26:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 142/427] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:26:09 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:10 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-plugged", "status": "completed", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}, {"server_uuid": "54d25a51-cd3f-4ea1-9de4-66de37fcb476", "name": "network-vif-deleted", "tag": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Creating event network-vif-plugged:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:26:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Creating event network-vif-deleted:55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 on user Apr 13 20:26:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042732 Apr 13 20:26:10 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 143/428] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:11 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-890810329", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4a18c4c0-217f-4ba3-96d6-c37b108efca9"}], "security_groups": [{"name": "tempest-securitygroup--461195573"}], "key_name": "tempest-keypair-1549482162", "user_data": "}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:11 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] validate_networks() for [('4a18c4c0-217f-4ba3-96d6-c37b108efca9', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for project 053f656470d94d2a9140f393bad01000. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for user 49383d6f0e7141548370d8bc3b96dfd9 and project 053f656470d94d2a9140f393bad01000. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:26:12 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:26:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.569589 Apr 13 20:26:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 144/429] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:26:11 2023] POST /compute/v2.1/servers => generated 399 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:26:12 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-f70e57a0-8443-4f79-a50f-e7f1925e9de4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:12 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-f70e57a0-8443-4f79-a50f-e7f1925e9de4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:12 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-f70e57a0-8443-4f79-a50f-e7f1925e9de4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:12 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-f70e57a0-8443-4f79-a50f-e7f1925e9de4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e" status: 200 len: 1235 microversion: 2.1 time: 0.147147 Apr 13 20:26:12 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 143/430] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:12 2023] GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e => generated 1235 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:26:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a4358f-82a4-408d-8206-49f05579b45e", "tag": "f0e44a58-4298-4a38-8717-df1a77e07a08"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:14 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=19 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:14 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] Creating event network-changed:f0e44a58-4298-4a38-8717-df1a77e07a08 for instance 24a4358f-82a4-408d-8206-49f05579b45e on user Apr 13 20:26:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043377 Apr 13 20:26:14 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 144/431] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:15 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] HTTP exception thrown: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Request method failure captured: Apr 13 20:26:15 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 HTTP/1.1 Apr 13 20:26:15 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:26:15 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:26:15 user devstack@n-api.service[61653]: Connection: close Apr 13 20:26:15 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:26:15 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:26:15 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:26:15 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:26:15 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOmzq0nwiJsCk00XiqmpX0ELkLMYn5tl5KYt34xhUMwtWAy_Rb2wo2L1baLmjq7xTp1JUJpITDivM3g4D2M-lNlY1EeA3Hejtk7OWPIKCdIgZJ9aZBzBhJ6jqRKWYuX9p2DdHywy53J4QMsLD9rRmTXVHnf9NGiVcYViLsNOtOh4WI Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Project-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/405aed9fca044ab39eabe188942230d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}] Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Tenant-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:26:15 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:26:15 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:26:15 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:26:15 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:26:15 user devstack@n-api.service[61653]: X-User-Id: 36e11efc98604eb7a8d5b95563431e45 Apr 13 20:26:15 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:26:15 user devstack@n-api.service[61653]: method: > Apr 13 20:26:15 user devstack@n-api.service[61653]: exception: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:26:15 user devstack@n-api.service[61653]: action_args: {'id': '2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9'} Apr 13 20:26:15 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:26:15 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:15 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Returning 404 to user: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:26:15 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-9317fa90-65c4-4a8e-a424-42236615f7bc tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 404 len: 111 microversion: 2.20 time: 0.028379 Apr 13 20:26:15 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 145/432] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:26:15 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:26:15 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-50a5dcaa-9382-46ee-bc6e-1ca43da8a88f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '.version_select at 0x7f7838135f30>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:15 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:15 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-50a5dcaa-9382-46ee-bc6e-1ca43da8a88f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146136459" status: 204 len: 0 microversion: 2.20 time: 0.035152 Apr 13 20:26:15 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 144/433] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 20:26:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146136459 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:26:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-fb1b7873-fa46-4b09-8fac-9de9b4a05c6f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'create', calling method: .version_select at 0x7f7833feb2e0>, body: {"keypair": {"name": "tempest-keypair-103925243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bjG5pVyew1iMJGqVQAxyEL2SLVPg9WtjkR2GAHwrOAtXUXLy5O5gyuSVZRjngyh7gzHwecvMgf5lTzLtkHEU+E+Li7QlCYySw1RXDYaRvTOjrN0y1RquDWwlSaxchVw=="}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:16 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-fb1b7873-fa46-4b09-8fac-9de9b4a05c6f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting quotas for project 405aed9fca044ab39eabe188942230d2. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:26:16 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-fb1b7873-fa46-4b09-8fac-9de9b4a05c6f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting quotas for user 36e11efc98604eb7a8d5b95563431e45 and project 405aed9fca044ab39eabe188942230d2. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:26:16 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-fb1b7873-fa46-4b09-8fac-9de9b4a05c6f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.080237 Apr 13 20:26:16 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 145/434] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 20:26:16 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 20:26:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4358f-82a4-408d-8206-49f05579b45e", "name": "network-vif-plugged", "status": "completed", "tag": "f0e44a58-4298-4a38-8717-df1a77e07a08"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:16 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:17 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:17 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] Creating event network-vif-plugged:f0e44a58-4298-4a38-8717-df1a77e07a08 for instance 24a4358f-82a4-408d-8206-49f05579b45e on user Apr 13 20:26:17 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038585 Apr 13 20:26:17 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 146/435] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:18 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1206860275", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc"}], "security_groups": [{"name": "tempest-securitygroup--1511733692"}], "key_name": "tempest-keypair-103925243", "user_data": "}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:18 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:18 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-29f3130d-bc2d-448b-8d0a-c43597ef7a16 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58" status: 200 len: 1491 microversion: 2.1 time: 0.223862 Apr 13 20:26:18 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 145/436] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:18 2023] GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58 => generated 1491 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:26:18 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] validate_networks() for [('c8b2ab21-23b9-4644-b252-4cd4bd700fbc', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:26:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4358f-82a4-408d-8206-49f05579b45e", "name": "network-vif-plugged", "status": "completed", "tag": "f0e44a58-4298-4a38-8717-df1a77e07a08"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] Creating event network-vif-plugged:f0e44a58-4298-4a38-8717-df1a77e07a08 for instance 24a4358f-82a4-408d-8206-49f05579b45e on user Apr 13 20:26:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060963 Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:26:19 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 147/437] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting quotas for project 405aed9fca044ab39eabe188942230d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting quotas for user 36e11efc98604eb7a8d5b95563431e45 and project 405aed9fca044ab39eabe188942230d2. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:26:19 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:26:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.803287 Apr 13 20:26:19 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 146/438] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 20:26:18 2023] POST /compute/v2.1/servers => generated 400 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 20:26:19 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d8874df2-0d6f-4ecd-8aa6-eb2c7421caf0 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:19 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d8874df2-0d6f-4ecd-8aa6-eb2c7421caf0 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:19 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-d8874df2-0d6f-4ecd-8aa6-eb2c7421caf0 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:19 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-d8874df2-0d6f-4ecd-8aa6-eb2c7421caf0 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:19 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-d8874df2-0d6f-4ecd-8aa6-eb2c7421caf0 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d8874df2-0d6f-4ecd-8aa6-eb2c7421caf0 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 200 len: 1275 microversion: 2.20 time: 0.143090 Apr 13 20:26:19 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 146/439] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:26:19 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 1275 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:26:22 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:22 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:22 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:22 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] Creating event network-changed:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:26:22 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038528 Apr 13 20:26:22 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 148/440] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:24 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-plugged", "status": "completed", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] Creating event network-vif-plugged:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:26:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037488 Apr 13 20:26:24 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 147/441] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-plugged", "status": "completed", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] Creating event network-vif-plugged:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:26:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066050 Apr 13 20:26:26 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 147/442] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=5 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=5 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:44 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8c0040be-2789-4bfe-a9ef-00e677909243 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1655 microversion: 2.1 time: 0.180928 Apr 13 20:26:44 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 149/443] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:44 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1655 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=10 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=5 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:44 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-96933d5d-4c23-4437-8c0e-5fb58529b373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1655 microversion: 2.1 time: 0.168012 Apr 13 20:26:44 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 148/444] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:44 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=8 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=8 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:47 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-9d6cebd7-b224-4a8b-a1e3-58457b2cb6d9 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081669 Apr 13 20:26:47 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:26:47 2023] GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:26:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:47 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae3eea8-5d28-46eb-8e84-86958032a048", "tag": "4c29a89c-5e3a-42f4-a315-8c579dc498ea"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] Creating event network-changed:4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 on user Apr 13 20:26:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031591 Apr 13 20:26:48 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 149/446] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:48 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:26:48 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048" status: 204 len: 0 microversion: 2.1 time: 0.118337 Apr 13 20:26:48 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 150/447] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:26:47 2023] DELETE /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:48 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:48 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-df059643-c5e5-4c07-9b7f-57cb8c2b8a68 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048" status: 200 len: 1664 microversion: 2.1 time: 0.199327 Apr 13 20:26:48 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:48 2023] GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048 => generated 1664 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:48 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-01fb1afa-5e3f-4900-9a3b-4c86c90afce7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1700 microversion: 2.1 time: 0.146577 Apr 13 20:26:48 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 150/449] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:48 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1700 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:26:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae3eea8-5d28-46eb-8e84-86958032a048", "name": "network-vif-deleted", "tag": "4c29a89c-5e3a-42f4-a315-8c579dc498ea"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] Creating event network-vif-deleted:4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 on user Apr 13 20:26:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029243 Apr 13 20:26:49 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 151/450] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:50 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae3eea8-5d28-46eb-8e84-86958032a048", "name": "network-vif-unplugged", "status": "completed", "tag": "4c29a89c-5e3a-42f4-a315-8c579dc498ea"}, {"server_uuid": "5ae3eea8-5d28-46eb-8e84-86958032a048", "name": "network-vif-plugged", "status": "completed", "tag": "4c29a89c-5e3a-42f4-a315-8c579dc498ea"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:50 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Creating event network-vif-unplugged:4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 on user Apr 13 20:26:50 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Creating event network-vif-plugged:4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 on user Apr 13 20:26:50 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031863 Apr 13 20:26:50 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 150/451] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:50 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:56 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:26:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf" status: 204 len: 0 microversion: 2.1 time: 0.117516 Apr 13 20:26:57 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 151/452] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:26:56 2023] DELETE /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:57 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:26:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4dade74e-fbc8-44f8-9755-c4f7f3f8c1b4 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf" status: 200 len: 1500 microversion: 2.1 time: 0.187690 Apr 13 20:26:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 152/453] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:57 2023] GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf => generated 1500 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:26:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f49fca-6bb7-4297-b903-4c4ddbe325cf", "name": "network-vif-unplugged", "status": "completed", "tag": "27e6da64-070b-4a09-8874-138a9490d844"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] Creating event network-vif-unplugged:27e6da64-070b-4a09-8874-138a9490d844 for instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf on user Apr 13 20:26:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032035 Apr 13 20:26:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 151/454] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-7d35df37-c1b4-4c6f-b9c4-eb3898ec3faf req-a8d9c62c-fa9f-475d-b8ac-fa6f278da67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f49fca-6bb7-4297-b903-4c4ddbe325cf", "name": "network-vif-deleted", "tag": "27e6da64-070b-4a09-8874-138a9490d844"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7d35df37-c1b4-4c6f-b9c4-eb3898ec3faf req-a8d9c62c-fa9f-475d-b8ac-fa6f278da67d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7d35df37-c1b4-4c6f-b9c4-eb3898ec3faf req-a8d9c62c-fa9f-475d-b8ac-fa6f278da67d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-7d35df37-c1b4-4c6f-b9c4-eb3898ec3faf req-a8d9c62c-fa9f-475d-b8ac-fa6f278da67d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-7d35df37-c1b4-4c6f-b9c4-eb3898ec3faf req-a8d9c62c-fa9f-475d-b8ac-fa6f278da67d service nova] Creating event network-vif-deleted:27e6da64-070b-4a09-8874-138a9490d844 for instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf on user Apr 13 20:26:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-7d35df37-c1b4-4c6f-b9c4-eb3898ec3faf req-a8d9c62c-fa9f-475d-b8ac-fa6f278da67d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034441 Apr 13 20:26:58 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 152/455] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] HTTP exception thrown: Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 could not be found. Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Request method failure captured: Apr 13 20:26:58 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 HTTP/1.1 Apr 13 20:26:58 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:26:58 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:26:58 user devstack@n-api.service[61653]: Connection: close Apr 13 20:26:58 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:26:58 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:26:58 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:26:58 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:26:58 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOgZSjgkVeqOJxmu4paLG8qqrI7H05koSH2sRZALfNRAV-XXc4rY8ugoFedbdrY_Fi04v2wJWq4Zz0JA8aZKSjeRv4twI-XrsRLPVbZXOjGeKVqbcaY8L59Jbwi68J91qUabELBcepJlDSDc5DAKW5EH09w9lRqSZ7U2rWMJUwf7yQ Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Project-Id: 4c3042be539b4749b37156c0e5a9d907 Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1796731705 Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3042be539b4749b37156c0e5a9d907"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c3042be539b4749b37156c0e5a9d907"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c3042be539b4749b37156c0e5a9d907"}]}] Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Tenant: tempest-ServerStableDeviceRescueTest-1796731705 Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Tenant-Id: 4c3042be539b4749b37156c0e5a9d907 Apr 13 20:26:58 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1796731705 Apr 13 20:26:58 user devstack@n-api.service[61653]: X-User: tempest-ServerStableDeviceRescueTest-1796731705-project-member Apr 13 20:26:58 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:26:58 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:26:58 user devstack@n-api.service[61653]: X-User-Id: 5cb2df6092c342e0b0f44c37abb4a88a Apr 13 20:26:58 user devstack@n-api.service[61653]: X-User-Name: tempest-ServerStableDeviceRescueTest-1796731705-project-member Apr 13 20:26:58 user devstack@n-api.service[61653]: method: > Apr 13 20:26:58 user devstack@n-api.service[61653]: exception: Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 could not be found. Apr 13 20:26:58 user devstack@n-api.service[61653]: action_args: {'id': '54d25a51-cd3f-4ea1-9de4-66de37fcb476'} Apr 13 20:26:58 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 could not be found. Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 could not be found. Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 could not be found. Apr 13 20:26:58 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:26:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Returning 404 to user: Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:26:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2699bf86-51d0-4ae9-b9b9-e4f3c45d57e1 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476" status: 404 len: 111 microversion: 2.1 time: 0.028962 Apr 13 20:26:58 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 153/456] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:26:58 2023] GET /compute/v2.1/servers/54d25a51-cd3f-4ea1-9de4-66de37fcb476 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:26:58 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-79b362a7-9dbf-4d25-93b2-2885ff0f8535 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Calling method '.version_select at 0x7f7833e2e710>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:26:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-79b362a7-9dbf-4d25-93b2-2885ff0f8535 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1968906009" status: 202 len: 0 microversion: 2.1 time: 0.027641 Apr 13 20:26:58 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 20:26:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1968906009 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:26:59 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f49fca-6bb7-4297-b903-4c4ddbe325cf", "name": "network-vif-plugged", "status": "completed", "tag": "27e6da64-070b-4a09-8874-138a9490d844"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:26:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:26:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:26:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:26:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] Creating event network-vif-plugged:27e6da64-070b-4a09-8874-138a9490d844 for instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf on user Apr 13 20:26:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035749 Apr 13 20:26:59 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 153/458] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:02 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:02 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b7d13187-5b75-43c3-a31e-3c43cab92574 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e" status: 200 len: 1544 microversion: 2.1 time: 0.148879 Apr 13 20:27:02 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 154/459] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:02 2023] GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e => generated 1544 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=16 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:09 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7f19e55a-bb15-4a95-b5d2-6a9df14317d9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 200 len: 1588 microversion: 2.20 time: 0.179148 Apr 13 20:27:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 153/460] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:27:09 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 1588 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:18 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:18 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-1b78f57e-0bd5-4a81-bcbe-dc861b65cc85 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 200 len: 1504 microversion: 2.1 time: 0.174389 Apr 13 20:27:18 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 154/461] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:18 2023] GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] HTTP exception thrown: Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 could not be found. Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Request method failure captured: Apr 13 20:27:38 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048 HTTP/1.1 Apr 13 20:27:38 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:27:38 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:27:38 user devstack@n-api.service[61653]: Connection: close Apr 13 20:27:38 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:27:38 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:27:38 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:27:38 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:27:38 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGQKrV_d2oUFpkvWJe_jPGyud1lDAhuJ4F4CJdeVdt_teIZImJptq67daXWUUNuMfVTCLA5yCmk8gN8m81J1rKEXn13iVFhwTdZ151dcrFTwNESzFBTzjIwbZ1HSFhnLNTFfsjhTby8gxScWEwidH2VzgdobQzHMGi_4Mr5y3iE7tZU Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Project-Id: d32350a5bf9a4d8b80c6bc1708387d1f Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Project-Name: tempest-TestStampPattern-1872935518 Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d32350a5bf9a4d8b80c6bc1708387d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d32350a5bf9a4d8b80c6bc1708387d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d32350a5bf9a4d8b80c6bc1708387d1f"}]}] Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Tenant: tempest-TestStampPattern-1872935518 Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Tenant-Id: d32350a5bf9a4d8b80c6bc1708387d1f Apr 13 20:27:38 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TestStampPattern-1872935518 Apr 13 20:27:38 user devstack@n-api.service[61653]: X-User: tempest-TestStampPattern-1872935518-project-member Apr 13 20:27:38 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:27:38 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:27:38 user devstack@n-api.service[61653]: X-User-Id: 29ed39378db34acd835d13c0cacad399 Apr 13 20:27:38 user devstack@n-api.service[61653]: X-User-Name: tempest-TestStampPattern-1872935518-project-member Apr 13 20:27:38 user devstack@n-api.service[61653]: method: > Apr 13 20:27:38 user devstack@n-api.service[61653]: exception: Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 could not be found. Apr 13 20:27:38 user devstack@n-api.service[61653]: action_args: {'id': '5ae3eea8-5d28-46eb-8e84-86958032a048'} Apr 13 20:27:38 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 could not be found. Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 could not be found. Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 could not be found. Apr 13 20:27:38 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Returning 404 to user: Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:27:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8b7818ab-f163-4546-8e50-cd7c02c5a91d tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048" status: 404 len: 111 microversion: 2.1 time: 0.045266 Apr 13 20:27:38 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 155/462] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:38 2023] GET /compute/v2.1/servers/5ae3eea8-5d28-46eb-8e84-86958032a048 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] HTTP exception thrown: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b is not attached to volume 14b662bc-beb2-4e07-bd32-8d54ee3e1748 Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Request method failure captured: Apr 13 20:27:43 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments/14b662bc-beb2-4e07-bd32-8d54ee3e1748 HTTP/1.1 Apr 13 20:27:43 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:27:43 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:27:43 user devstack@n-api.service[61655]: Connection: close Apr 13 20:27:43 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:27:43 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:27:43 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:27:43 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:27:43 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGQKrV_d2oUFpkvWJe_jPGyud1lDAhuJ4F4CJdeVdt_teIZImJptq67daXWUUNuMfVTCLA5yCmk8gN8m81J1rKEXn13iVFhwTdZ151dcrFTwNESzFBTzjIwbZ1HSFhnLNTFfsjhTby8gxScWEwidH2VzgdobQzHMGi_4Mr5y3iE7tZU Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Project-Id: d32350a5bf9a4d8b80c6bc1708387d1f Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Project-Name: tempest-TestStampPattern-1872935518 Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d32350a5bf9a4d8b80c6bc1708387d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d32350a5bf9a4d8b80c6bc1708387d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d32350a5bf9a4d8b80c6bc1708387d1f"}]}] Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Tenant: tempest-TestStampPattern-1872935518 Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Tenant-Id: d32350a5bf9a4d8b80c6bc1708387d1f Apr 13 20:27:43 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TestStampPattern-1872935518 Apr 13 20:27:43 user devstack@n-api.service[61655]: X-User: tempest-TestStampPattern-1872935518-project-member Apr 13 20:27:43 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:27:43 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:27:43 user devstack@n-api.service[61655]: X-User-Id: 29ed39378db34acd835d13c0cacad399 Apr 13 20:27:43 user devstack@n-api.service[61655]: X-User-Name: tempest-TestStampPattern-1872935518-project-member Apr 13 20:27:43 user devstack@n-api.service[61655]: method: > Apr 13 20:27:43 user devstack@n-api.service[61655]: exception: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b is not attached to volume 14b662bc-beb2-4e07-bd32-8d54ee3e1748 Apr 13 20:27:43 user devstack@n-api.service[61655]: action_args: {'server_id': 'b9e0bb04-2572-4973-af9c-a607ca0b170b', 'id': '14b662bc-beb2-4e07-bd32-8d54ee3e1748'} Apr 13 20:27:43 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 14b662bc-beb2-4e07-bd32-8d54ee3e1748. Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b is not attached to volume 14b662bc-beb2-4e07-bd32-8d54ee3e1748 Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b is not attached to volume 14b662bc-beb2-4e07-bd32-8d54ee3e1748 Apr 13 20:27:43 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Returning 404 to user: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b is not attached to volume 14b662bc-beb2-4e07-bd32-8d54ee3e1748 {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:27:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4dcfed08-c3a7-4958-9055-43b63ba7ff0e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments/14b662bc-beb2-4e07-bd32-8d54ee3e1748" status: 404 len: 154 microversion: 2.1 time: 0.093020 Apr 13 20:27:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 154/463] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:27:42 2023] DELETE /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b/os-volume_attachments/14b662bc-beb2-4e07-bd32-8d54ee3e1748 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:43 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e0bb04-2572-4973-af9c-a607ca0b170b", "tag": "a174e8a4-6618-4819-92fe-4e08da521d07"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] Creating event network-changed:a174e8a4-6618-4819-92fe-4e08da521d07 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b on user Apr 13 20:27:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032286 Apr 13 20:27:43 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 156/464] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:27:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:27:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:27:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b" status: 204 len: 0 microversion: 2.1 time: 0.169829 Apr 13 20:27:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 155/465] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:27:43 2023] DELETE /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:44 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b812a524-4038-4f99-8a65-706d0e392c4a tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b" status: 200 len: 1665 microversion: 2.1 time: 0.221479 Apr 13 20:27:44 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 155/466] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:43 2023] GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b => generated 1665 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:27:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e0bb04-2572-4973-af9c-a607ca0b170b", "name": "network-vif-unplugged", "status": "completed", "tag": "a174e8a4-6618-4819-92fe-4e08da521d07"}, {"server_uuid": "b9e0bb04-2572-4973-af9c-a607ca0b170b", "name": "network-vif-plugged", "status": "completed", "tag": "a174e8a4-6618-4819-92fe-4e08da521d07"}, {"server_uuid": "b9e0bb04-2572-4973-af9c-a607ca0b170b", "name": "network-vif-deleted", "tag": "a174e8a4-6618-4819-92fe-4e08da521d07"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Creating event network-vif-unplugged:a174e8a4-6618-4819-92fe-4e08da521d07 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b on user Apr 13 20:27:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Creating event network-vif-plugged:a174e8a4-6618-4819-92fe-4e08da521d07 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b on user Apr 13 20:27:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Creating event network-vif-deleted:a174e8a4-6618-4819-92fe-4e08da521d07 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b on user Apr 13 20:27:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034680 Apr 13 20:27:45 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 157/467] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:27:45 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-10f33eaf-c6d2-41a5-b7d1-adb12898e7ca tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1655 microversion: 2.1 time: 0.209490 Apr 13 20:27:47 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 156/468] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:47 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1655 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:27:47 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1017ad5b-45cd-4f0b-a368-4af26c71c74c"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:47 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] HTTP exception thrown: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Request method failure captured: Apr 13 20:27:47 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf HTTP/1.1 Apr 13 20:27:47 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:27:47 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:27:47 user devstack@n-api.service[61653]: Connection: close Apr 13 20:27:47 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:27:47 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:27:47 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:27:47 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:27:47 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGSy0RRVrvbeuhV0rDQ0vFk4saltPGHtuhgzpETnNmsVIOBVVJHkz1GIW-OaHmWcK9l5MjeE7cMI99YF9o7TaSHLlQnYMVkEi53CyqgchxqgboFQGFW9pSyvlk6YBgOrTqNFMj5JIrvJWZEvY3TtnUdGNLiHdr-r3yNHDOm3LI1VOKk Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Project-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/376fa6e005894aee80e4398704d956a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}] Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Tenant: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Tenant-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:27:47 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:27:47 user devstack@n-api.service[61653]: X-User: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:27:47 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:27:47 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:27:47 user devstack@n-api.service[61653]: X-User-Id: e39152c6dfed4218aa473532c49844ff Apr 13 20:27:47 user devstack@n-api.service[61653]: X-User-Name: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:27:47 user devstack@n-api.service[61653]: method: > Apr 13 20:27:47 user devstack@n-api.service[61653]: exception: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:27:47 user devstack@n-api.service[61653]: action_args: {'id': '31f49fca-6bb7-4297-b903-4c4ddbe325cf'} Apr 13 20:27:47 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:27:47 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:27:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Returning 404 to user: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:27:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a5752a2b-a53a-4896-824e-c01fbbc3a9cc tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf" status: 404 len: 111 microversion: 2.1 time: 0.034252 Apr 13 20:27:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 158/469] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:47 2023] GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:47 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-3e91682f-843c-4bba-8c1e-e7dcd6e3e80f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 200 len: 1494 microversion: 2.1 time: 0.155922 Apr 13 20:27:47 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 157/470] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:47 2023] GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 1494 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:27:47 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278991 Apr 13 20:27:47 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 156/471] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:27:47 2023] POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:49 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'services' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:27:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/os-volume_attachments/6aa89e26-6353-427a-a9ef-10c96effef8e" status: 202 len: 0 microversion: 2.1 time: 0.502947 Apr 13 20:27:49 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 159/472] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:27:49 2023] DELETE /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/os-volume_attachments/6aa89e26-6353-427a-a9ef-10c96effef8e => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:27:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:52 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Going to try to stop instance {{(pid=61654) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 20:27:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/action" status: 202 len: 0 microversion: 2.1 time: 0.092685 Apr 13 20:27:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 158/473] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:27:52 2023] POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:27:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:52 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:53 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8772c02c-5d69-49cb-baa9-3ada0fd1232d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1664 microversion: 2.1 time: 0.190007 Apr 13 20:27:53 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 157/474] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:52 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1664 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:27:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-unplugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] Creating event network-vif-unplugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:27:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041185 Apr 13 20:27:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 160/475] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:27:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:27:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035378 Apr 13 20:27:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 158/476] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:27:55 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9b51ca50-5e4e-4112-b5c6-bf5851927925 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1701 microversion: 2.1 time: 0.158575 Apr 13 20:27:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:55 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-181194148", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for project c0e9553d7d1f49f68d3b20cb647f2062. Resources: dict_keys(['metadata_items']) {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for user 04d351d2822a460d93748b98161d730c and project c0e9553d7d1f49f68d3b20cb647f2062. Resources: dict_keys(['metadata_items']) {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/action" status: 202 len: 1158 microversion: 2.1 time: 0.345309 Apr 13 20:27:55 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 161/478] 10.0.0.210 () {64 vars in 1356 bytes} [Thu Apr 13 20:27:55 2023] POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/action => generated 1158 bytes in 347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:55 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:27:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1a919b9b-53f5-4f57-82c2-0141e228fae7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1730 microversion: 2.1 time: 0.184651 Apr 13 20:27:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 159/479] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:27:55 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:27:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] Creating event network-vif-unplugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:27:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050525 Apr 13 20:27:56 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 160/480] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:27:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:27:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:27:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:27:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:27:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:27:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:27:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028759 Apr 13 20:27:58 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 162/481] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:27:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:28:02 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:02 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:02 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a9f81748-ed41-4a28-ad21-df000f616e99 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.114255 Apr 13 20:28:02 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 160/482] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:28:02 2023] GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e/os-interface => generated 283 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a4358f-82a4-408d-8206-49f05579b45e", "tag": "f0e44a58-4298-4a38-8717-df1a77e07a08"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] Creating event network-changed:f0e44a58-4298-4a38-8717-df1a77e07a08 for instance 24a4358f-82a4-408d-8206-49f05579b45e on user Apr 13 20:28:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039784 Apr 13 20:28:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 161/483] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b928ad32-5364-4592-915b-633998c62363 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e/ips" status: 200 len: 108 microversion: 2.1 time: 0.046772 Apr 13 20:28:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 163/484] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:28:04 2023] GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e/ips => generated 108 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c609f609-6cab-47d1-85eb-bf8ad9a0a959"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Invalid volume: volume c609f609-6cab-47d1-85eb-bf8ad9a0a959 is already attached to instances: a369e185-3d75-4dde-8e8a-0e397aab892b Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:28:04 user devstack@n-api.service[61655]: request: POST /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e/os-volume_attachments HTTP/1.1 Apr 13 20:28:04 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:28:04 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:28:04 user devstack@n-api.service[61655]: Connection: close Apr 13 20:28:04 user devstack@n-api.service[61655]: Content-Length: 74 Apr 13 20:28:04 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:28:04 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:28:04 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:28:04 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:28:04 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:28:04 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:28:04 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:28:04 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:28:04 user devstack@n-api.service[61655]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:28:04 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:28:04 user devstack@n-api.service[61655]: Apr 13 20:28:04 user devstack@n-api.service[61655]: {"volumeAttachment": {"volumeId": "c609f609-6cab-47d1-85eb-bf8ad9a0a959"}} Apr 13 20:28:04 user devstack@n-api.service[61655]: method: > Apr 13 20:28:04 user devstack@n-api.service[61655]: exception: Invalid volume: volume c609f609-6cab-47d1-85eb-bf8ad9a0a959 is already attached to instances: a369e185-3d75-4dde-8e8a-0e397aab892b Apr 13 20:28:04 user devstack@n-api.service[61655]: action_args: {'server_id': '24a4358f-82a4-408d-8206-49f05579b45e', 'body': {'volumeAttachment': {'volumeId': 'c609f609-6cab-47d1-85eb-bf8ad9a0a959'}}} Apr 13 20:28:04 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c609f609-6cab-47d1-85eb-bf8ad9a0a959 is already attached to instances: a369e185-3d75-4dde-8e8a-0e397aab892b Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c609f609-6cab-47d1-85eb-bf8ad9a0a959 is already attached to instances: a369e185-3d75-4dde-8e8a-0e397aab892b Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c609f609-6cab-47d1-85eb-bf8ad9a0a959 is already attached to instances: a369e185-3d75-4dde-8e8a-0e397aab892b Apr 13 20:28:04 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 400 to user: Invalid volume: volume c609f609-6cab-47d1-85eb-bf8ad9a0a959 is already attached to instances: a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:28:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-86a7cef6-1b30-4c8a-99d4-515b2c52689d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142245 Apr 13 20:28:04 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 161/485] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:28:04 2023] POST /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:28:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e" status: 204 len: 0 microversion: 2.1 time: 0.112172 Apr 13 20:28:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 162/486] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:28:04 2023] DELETE /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-ebc8d327-61b1-4cf6-a0f9-07083d219f13 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e" status: 200 len: 1550 microversion: 2.1 time: 0.198585 Apr 13 20:28:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 164/487] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:28:04 2023] GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e => generated 1550 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4358f-82a4-408d-8206-49f05579b45e", "name": "network-vif-unplugged", "status": "completed", "tag": "f0e44a58-4298-4a38-8717-df1a77e07a08"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] Creating event network-vif-unplugged:f0e44a58-4298-4a38-8717-df1a77e07a08 for instance 24a4358f-82a4-408d-8206-49f05579b45e on user Apr 13 20:28:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044633 Apr 13 20:28:04 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 162/488] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:05 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4358f-82a4-408d-8206-49f05579b45e", "name": "network-vif-deleted", "tag": "f0e44a58-4298-4a38-8717-df1a77e07a08"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] Creating event network-vif-deleted:f0e44a58-4298-4a38-8717-df1a77e07a08 for instance 24a4358f-82a4-408d-8206-49f05579b45e on user Apr 13 20:28:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Apr 13 20:28:05 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 163/489] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:06 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a4358f-82a4-408d-8206-49f05579b45e", "name": "network-vif-plugged", "status": "completed", "tag": "f0e44a58-4298-4a38-8717-df1a77e07a08"}, {"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Creating event network-vif-plugged:f0e44a58-4298-4a38-8717-df1a77e07a08 for instance 24a4358f-82a4-408d-8206-49f05579b45e on user Apr 13 20:28:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:28:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039865 Apr 13 20:28:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 165/490] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:08 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:28:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030251 Apr 13 20:28:08 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 163/491] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:09 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:09 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-208c3116-8c92-4582-ac10-99dc566261d2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.093556 Apr 13 20:28:09 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 164/492] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 20:28:09 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/os-interface => generated 283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=35 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:10 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=3,nova_cell1:UPDATE=4,nova_cell1:DELETE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0bc79eaf-f1d8-483d-99dc-f231dd9b2858 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/ips" status: 200 len: 111 microversion: 2.20 time: 0.047491 Apr 13 20:28:10 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 166/493] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 20:28:10 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/ips => generated 111 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:28:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] Creating event network-changed:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:28:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038548 Apr 13 20:28:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 164/494] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'flavor' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-59745dbb-4108-4963-acdb-b38adb62febb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'create', calling method: .version_select at 0x7f78381b65f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1162257408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjmSqvUl8KqxiWYpdbV8fcEEJPM9DquBNTt3TC9TUyCrrXzATpO/iMAndzY/Y7lHxaegFQjzFNIJq9Yrb36neOFYFS6PE2/nBc36qUiuAjBI2rGirfj3b0THTtE8AYLHQ=="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-59745dbb-4108-4963-acdb-b38adb62febb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting quotas for project 41f1e999778042e2a606a2ae4072bc83. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-59745dbb-4108-4963-acdb-b38adb62febb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting quotas for user 519afe2b763347ea889f7de8773d7de0 and project 41f1e999778042e2a606a2ae4072bc83. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:28:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-59745dbb-4108-4963-acdb-b38adb62febb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.067735 Apr 13 20:28:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 167/495] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:28:12 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2066526535", "imageRef": "54a85f0f-585c-4c38-b211-c4a8d01d6811", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1162257408", "networks": [{"uuid": "01cb6d35-c31b-48c0-8594-46a80ae181d6"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] validate_networks() for [('01cb6d35-c31b-48c0-8594-46a80ae181d6', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting quotas for project 41f1e999778042e2a606a2ae4072bc83. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting quotas for user 519afe2b763347ea889f7de8773d7de0 and project 41f1e999778042e2a606a2ae4072bc83. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:28:12 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='54a85f0f-585c-4c38-b211-c4a8d01d6811',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:28:12 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/action" status: 202 len: 0 microversion: 2.20 time: 0.799459 Apr 13 20:28:12 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 165/496] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 20:28:12 2023] POST /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:12 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.577062 Apr 13 20:28:12 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 165/497] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:28:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-14122891-0986-4c3b-b5e7-7a1628e98912 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:12 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-14122891-0986-4c3b-b5e7-7a1628e98912 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:13 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-14122891-0986-4c3b-b5e7-7a1628e98912 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:13 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-14122891-0986-4c3b-b5e7-7a1628e98912 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1253 microversion: 2.1 time: 0.097306 Apr 13 20:28:13 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 166/498] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:28:12 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1253 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:28:13 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:13 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:13 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7ccfc6b8-e8be-4331-a7cf-02a0fcd062c2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 200 len: 1713 microversion: 2.20 time: 0.191528 Apr 13 20:28:13 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 168/499] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:28:12 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 1713 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:28:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-unplugged", "status": "completed", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:13 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:13 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] Creating event network-vif-unplugged:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:28:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032327 Apr 13 20:28:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 166/500] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:15 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-plugged", "status": "completed", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:15 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:15 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] Creating event network-vif-plugged:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:28:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034227 Apr 13 20:28:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 167/501] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:15 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:15 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] Creating event network-changed:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:28:15 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029918 Apr 13 20:28:15 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 169/502] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:18 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:18 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:28:18 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037113 Apr 13 20:28:18 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 167/503] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:20 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'flavor' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:28:20 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e/action" status: 200 len: 32 microversion: 2.1 time: 0.111856 Apr 13 20:28:20 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 168/504] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:28:20 2023] POST /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:20 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}, {"name": "network-changed", "server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:28:20 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.compute.server_external_events [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Unable to find a host for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962. Dropping event network-changed {{(pid=61655) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 13 20:28:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 347 microversion: 2.1 time: 0.043657 Apr 13 20:28:20 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 168/505] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:20 2023] POST /compute/v2.1/os-server-external-events => generated 347 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 13 20:28:20 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8f01d074-b8a5-49e9-9c00-1e072c038fd1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 200 len: 1510 microversion: 2.1 time: 0.201492 Apr 13 20:28:20 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 170/506] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:28:20 2023] GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:28:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-unplugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}, {"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Creating event network-vif-unplugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:28:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:28:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030483 Apr 13 20:28:22 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 169/507] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:22 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:24 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:24 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:24 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}, {"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:24 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:28:24 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:28:24 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031272 Apr 13 20:28:24 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 169/508] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:28:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=17 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] HTTP exception thrown: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b could not be found. Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Request method failure captured: Apr 13 20:28:34 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b HTTP/1.1 Apr 13 20:28:34 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:28:34 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:28:34 user devstack@n-api.service[61653]: Connection: close Apr 13 20:28:34 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:28:34 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:28:34 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:28:34 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:28:34 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGQKrV_d2oUFpkvWJe_jPGyud1lDAhuJ4F4CJdeVdt_teIZImJptq67daXWUUNuMfVTCLA5yCmk8gN8m81J1rKEXn13iVFhwTdZ151dcrFTwNESzFBTzjIwbZ1HSFhnLNTFfsjhTby8gxScWEwidH2VzgdobQzHMGi_4Mr5y3iE7tZU Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Project-Id: d32350a5bf9a4d8b80c6bc1708387d1f Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Project-Name: tempest-TestStampPattern-1872935518 Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d32350a5bf9a4d8b80c6bc1708387d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d32350a5bf9a4d8b80c6bc1708387d1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d32350a5bf9a4d8b80c6bc1708387d1f"}]}] Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Tenant: tempest-TestStampPattern-1872935518 Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Tenant-Id: d32350a5bf9a4d8b80c6bc1708387d1f Apr 13 20:28:34 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TestStampPattern-1872935518 Apr 13 20:28:34 user devstack@n-api.service[61653]: X-User: tempest-TestStampPattern-1872935518-project-member Apr 13 20:28:34 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:28:34 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:28:34 user devstack@n-api.service[61653]: X-User-Id: 29ed39378db34acd835d13c0cacad399 Apr 13 20:28:34 user devstack@n-api.service[61653]: X-User-Name: tempest-TestStampPattern-1872935518-project-member Apr 13 20:28:34 user devstack@n-api.service[61653]: method: > Apr 13 20:28:34 user devstack@n-api.service[61653]: exception: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b could not be found. Apr 13 20:28:34 user devstack@n-api.service[61653]: action_args: {'id': 'b9e0bb04-2572-4973-af9c-a607ca0b170b'} Apr 13 20:28:34 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b could not be found. Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b could not be found. Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b could not be found. Apr 13 20:28:34 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Returning 404 to user: Instance b9e0bb04-2572-4973-af9c-a607ca0b170b could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:28:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3c5c75fd-0def-4ddf-b622-71552bb55625 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b" status: 404 len: 111 microversion: 2.1 time: 0.039521 Apr 13 20:28:34 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 171/509] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:28:34 2023] GET /compute/v2.1/servers/b9e0bb04-2572-4973-af9c-a607ca0b170b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:28:37 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:37 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=5 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:37 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:37 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-29a8dc24-226b-4ecb-b1e4-311314fc3f65 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Calling method '.version_select at 0x7f7833e7f910>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:37 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-29a8dc24-226b-4ecb-b1e4-311314fc3f65 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1904080569" status: 202 len: 0 microversion: 2.1 time: 0.036730 Apr 13 20:28:37 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 170/510] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:28:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1904080569 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=7 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=7 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:43 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a9431ef7-8aa2-4ae8-811e-b55902c9288b tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1641 microversion: 2.1 time: 0.226685 Apr 13 20:28:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 170/511] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:28:43 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1641 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:46 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6663a4c7-ef4c-4588-a595-f151036ab96c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1721 microversion: 2.1 time: 0.181570 Apr 13 20:28:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 172/512] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:28:45 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:28:49 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:28:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-efb0ce96-d89f-4643-8647-9843d8973efe tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-827455948", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "251a3b5e-bf74-43cd-b776-7f04522ba7e0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba"}]}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:28:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-efb0ce96-d89f-4643-8647-9843d8973efe tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] HTTP exception thrown: Block Device 251a3b5e-bf74-43cd-b776-7f04522ba7e0 is not bootable. Apr 13 20:28:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-efb0ce96-d89f-4643-8647-9843d8973efe tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Request method failure captured: Apr 13 20:28:49 user devstack@n-api.service[61654]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 20:28:49 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:28:49 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:28:49 user devstack@n-api.service[61654]: Connection: close Apr 13 20:28:49 user devstack@n-api.service[61654]: Content-Length: 356 Apr 13 20:28:49 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:28:49 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:28:49 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:28:49 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGSy0RRVrvbeuhV0rDQ0vFk4saltPGHtuhgzpETnNmsVIOBVVJHkz1GIW-OaHmWcK9l5MjeE7cMI99YF9o7TaSHLlQnYMVkEi53CyqgchxqgboFQGFW9pSyvlk6YBgOrTqNFMj5JIrvJWZEvY3TtnUdGNLiHdr-r3yNHDOm3LI1VOKk Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Project-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Project-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/376fa6e005894aee80e4398704d956a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}] Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Tenant: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Tenant-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:28:49 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:28:49 user devstack@n-api.service[61654]: X-User: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:28:49 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:28:49 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:28:49 user devstack@n-api.service[61654]: X-User-Id: e39152c6dfed4218aa473532c49844ff Apr 13 20:28:49 user devstack@n-api.service[61654]: X-User-Name: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:28:49 user devstack@n-api.service[61654]: Apr 13 20:28:49 user devstack@n-api.service[61654]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-827455948", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "251a3b5e-bf74-43cd-b776-7f04522ba7e0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba"}]}} Apr 13 20:28:49 user devstack@n-api.service[61654]: method: > Apr 13 20:28:49 user devstack@n-api.service[61654]: exception: Block Device 251a3b5e-bf74-43cd-b776-7f04522ba7e0 is not bootable. Apr 13 20:28:49 user devstack@n-api.service[61654]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-827455948', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '251a3b5e-bf74-43cd-b776-7f04522ba7e0'}], 'networks': [{'uuid': 'a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba'}]}}} Apr 13 20:28:49 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 251a3b5e-bf74-43cd-b776-7f04522ba7e0 is not bootable. Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 251a3b5e-bf74-43cd-b776-7f04522ba7e0 is not bootable. Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 251a3b5e-bf74-43cd-b776-7f04522ba7e0 is not bootable. Apr 13 20:28:49 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:28:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-efb0ce96-d89f-4643-8647-9843d8973efe tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Returning 400 to user: Block Device 251a3b5e-bf74-43cd-b776-7f04522ba7e0 is not bootable. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:28:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-efb0ce96-d89f-4643-8647-9843d8973efe tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.080497 Apr 13 20:28:49 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 171/513] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:28:49 2023] POST /compute/v2.1/servers => generated 110 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:49 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:28:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7143a629-de6d-4623-b4ae-eeac47f39b38 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 200 len: 1494 microversion: 2.1 time: 0.162284 Apr 13 20:28:49 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 171/514] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:28:49 2023] GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 1494 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:28:54 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e HTTP/1.1 Apr 13 20:28:54 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:28:54 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:28:54 user devstack@n-api.service[61653]: Connection: close Apr 13 20:28:54 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:28:54 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:28:54 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:28:54 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:28:54 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:28:54 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:28:54 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:28:54 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:28:54 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:28:54 user devstack@n-api.service[61653]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:28:54 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:28:54 user devstack@n-api.service[61653]: method: > Apr 13 20:28:54 user devstack@n-api.service[61653]: exception: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:28:54 user devstack@n-api.service[61653]: action_args: {'id': '24a4358f-82a4-408d-8206-49f05579b45e'} Apr 13 20:28:54 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:28:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:28:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:28:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c2911027-8a11-475e-93f6-5891cab9426f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e" status: 404 len: 111 microversion: 2.1 time: 0.036388 Apr 13 20:28:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 173/515] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:28:54 2023] GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:28:54 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-180aff5f-f02b-4134-877b-2e3cc5a0ffc5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '.version_select at 0x7f78381cf640>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:54 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-180aff5f-f02b-4134-877b-2e3cc5a0ffc5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549482162" status: 202 len: 0 microversion: 2.1 time: 0.034510 Apr 13 20:28:54 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 172/516] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 20:28:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549482162 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:55 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'services' on Instance uuid a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:28:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-volume_attachments/c609f609-6cab-47d1-85eb-bf8ad9a0a959" status: 202 len: 0 microversion: 2.1 time: 0.398183 Apr 13 20:28:56 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 172/517] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:28:55 2023] DELETE /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-volume_attachments/c609f609-6cab-47d1-85eb-bf8ad9a0a959 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:28:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:28:56 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:28:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:28:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:28:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:28:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a07ac3e9-c84c-4b33-b4a6-924b2a6c5c51 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046099 Apr 13 20:28:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 174/518] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:28:56 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:03 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:03 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6795ef0b-a4c1-436c-8010-55461ab648e6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1538 microversion: 2.1 time: 0.293595 Apr 13 20:29:03 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 173/519] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:03 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1538 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:03 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-0d93e854-d0de-4106-9eeb-51031202a023 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 200 len: 1654 microversion: 2.20 time: 0.574682 Apr 13 20:29:03 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 173/520] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:29:03 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 1654 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-301039361", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "bec4620f-ff7e-4c6f-b44a-c5794c41cdb8", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0"}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] validate_networks() for [('e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for user 7e478a11b57b4ee385e33c4709adf04b and project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:29:04 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='bec4620f-ff7e-4c6f-b44a-c5794c41cdb8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:29:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.663170 Apr 13 20:29:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 175/521] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:29:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:29:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-734d09a0-0a9b-4bd4-8e82-aacf2cf081ad tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:04 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-734d09a0-0a9b-4bd4-8e82-aacf2cf081ad tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:04 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-734d09a0-0a9b-4bd4-8e82-aacf2cf081ad tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-734d09a0-0a9b-4bd4-8e82-aacf2cf081ad tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 200 len: 1051 microversion: 2.1 time: 0.058940 Apr 13 20:29:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 174/522] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:04 2023] GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 1051 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:29:07 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee274ffc-0455-4733-8a69-33f1210ed781", "tag": "7a7478fd-2933-48b0-acdb-1bab32cefd46"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:07 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:07 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] Creating event network-changed:7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance ee274ffc-0455-4733-8a69-33f1210ed781 on user Apr 13 20:29:07 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094288 Apr 13 20:29:07 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 174/523] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:29:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:10 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-00941c8e-4b14-4edd-940d-ce3687a836f5 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 200 len: 1490 microversion: 2.1 time: 0.264568 Apr 13 20:29:10 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 176/524] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:10 2023] GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 1490 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:29:19 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:19 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:19 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:19 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee274ffc-0455-4733-8a69-33f1210ed781", "name": "network-vif-plugged", "status": "completed", "tag": "7a7478fd-2933-48b0-acdb-1bab32cefd46"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] Creating event network-vif-plugged:7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance ee274ffc-0455-4733-8a69-33f1210ed781 on user Apr 13 20:29:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110845 Apr 13 20:29:19 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 175/525] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:29:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:29:21 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=10 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:21 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:21 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee274ffc-0455-4733-8a69-33f1210ed781", "name": "network-vif-plugged", "status": "completed", "tag": "7a7478fd-2933-48b0-acdb-1bab32cefd46"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:21 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] Creating event network-vif-plugged:7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance ee274ffc-0455-4733-8a69-33f1210ed781 on user Apr 13 20:29:21 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036410 Apr 13 20:29:21 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 175/526] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:29:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=22 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:43 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Going to try to start instance {{(pid=61653) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 20:29:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/action" status: 202 len: 0 microversion: 2.1 time: 0.078593 Apr 13 20:29:43 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 177/527] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:29:43 2023] POST /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:43 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-682b77cb-6d25-4cce-a01a-d47a3f552fb4 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1650 microversion: 2.1 time: 0.172735 Apr 13 20:29:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 176/528] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:43 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1650 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a02544bd-a710-4880-84b6-398f2645c707 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.186264 Apr 13 20:29:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 176/529] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:29:46 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b/os-volume_attachments => generated 25 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:29:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031235 Apr 13 20:29:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 177/530] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:29:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b" status: 204 len: 0 microversion: 2.1 time: 0.131362 Apr 13 20:29:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 177/531] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:29:46 2023] DELETE /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:29:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1064cb83-590a-484b-b43d-1cbfec030499 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1721 microversion: 2.1 time: 0.314743 Apr 13 20:29:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 178/532] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:46 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2d0a6d87-9358-4e7c-b0e9-a6fdcf077831 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b" status: 200 len: 1667 microversion: 2.1 time: 0.269496 Apr 13 20:29:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 178/533] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:46 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b => generated 1667 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a369e185-3d75-4dde-8e8a-0e397aab892b", "name": "network-vif-unplugged", "status": "completed", "tag": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] Creating event network-vif-unplugged:d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance a369e185-3d75-4dde-8e8a-0e397aab892b on user Apr 13 20:29:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032189 Apr 13 20:29:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 179/534] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:29:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:29:46 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-f0056182-ce38-4b98-a2a0-2f097345995f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1721 microversion: 2.1 time: 0.203052 Apr 13 20:29:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 178/535] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:46 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:29:48 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}, {"server_uuid": "a369e185-3d75-4dde-8e8a-0e397aab892b", "name": "network-vif-deleted", "tag": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:29:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Creating event network-vif-deleted:d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance a369e185-3d75-4dde-8e8a-0e397aab892b on user Apr 13 20:29:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050149 Apr 13 20:29:48 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 179/536] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:29:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:29:48 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a369e185-3d75-4dde-8e8a-0e397aab892b", "name": "network-vif-plugged", "status": "completed", "tag": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:29:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:48 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] Creating event network-vif-plugged:d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance a369e185-3d75-4dde-8e8a-0e397aab892b on user Apr 13 20:29:48 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030627 Apr 13 20:29:48 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 180/537] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:29:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:49 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b7033175-dc67-4584-8d7b-27de21916a40 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 200 len: 1494 microversion: 2.1 time: 0.189554 Apr 13 20:29:49 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 179/538] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:49 2023] GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 1494 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:29:54 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:29:54 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:29:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:29:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:29:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:29:55 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:29:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-8499c8dd-ae57-4d4b-9b67-e17d7906d565 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 200 len: 1378 microversion: 2.1 time: 0.157963 Apr 13 20:29:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 180/539] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:29:54 2023] GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 1378 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:03 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:03 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-65f500d7-119b-4209-ade9-4285cee0a1bc tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1538 microversion: 2.1 time: 0.174466 Apr 13 20:30:03 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 181/540] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:03 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1538 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Searching by: {'deleted': False, 'project_id': '41f1e999778042e2a606a2ae4072bc83'} {{(pid=61655) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:03 user devstack@n-api.service[61655]: DEBUG nova.compute.multi_cell_list [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61655) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 20:30:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7a1369ef-996d-401e-bd5b-aca2ba4ff3f1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.162987 Apr 13 20:30:03 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 180/541] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 20:30:03 2023] GET /compute/v2.1/servers => generated 341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:03 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:03 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-5d86fe78-7ee3-4fb6-82e8-192be400c951 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1538 microversion: 2.1 time: 0.144335 Apr 13 20:30:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 181/542] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:03 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1538 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cecb5d98-48c1-49c9-be6e-802983609470"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-512745f8-cfc5-4c8a-a62d-b00b2938f41d tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.430559 Apr 13 20:30:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 182/543] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 20:30:03 2023] POST /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/os-volume_attachments => generated 188 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 13 20:30:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:04 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-0ad9818a-5527-484d-a0ad-9114ec028cdf tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/os-volume_attachments/cecb5d98-48c1-49c9-be6e-802983609470" status: 202 len: 0 microversion: 2.20 time: 0.282845 Apr 13 20:30:04 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 181/544] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 20:30:04 2023] DELETE /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/os-volume_attachments/cecb5d98-48c1-49c9-be6e-802983609470 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:04 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61654) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 20:30:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/action" status: 202 len: 0 microversion: 2.20 time: 0.129138 Apr 13 20:30:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 182/545] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 20:30:04 2023] POST /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:05 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:05 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:05 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:05 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-db7a91c5-7071-4d4b-8eb4-4501e0536543 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 200 len: 1662 microversion: 2.20 time: 0.195786 Apr 13 20:30:05 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 183/546] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:30:04 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 1662 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:30:05 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80e647b5-ac5e-491b-acfc-32f350f2cc4a"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:05 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:05 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269552 Apr 13 20:30:05 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 182/547] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:30:05 2023] POST /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:07 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] Creating event network-changed:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:30:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031951 Apr 13 20:30:07 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 183/548] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6edd1f88-ac53-4939-bda8-764647abbef4"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e while it is in vm_state rescued Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Request method failure captured: Apr 13 20:30:10 user devstack@n-api.service[61653]: request: POST /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e/os-volume_attachments HTTP/1.1 Apr 13 20:30:10 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:30:10 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:30:10 user devstack@n-api.service[61653]: Connection: close Apr 13 20:30:10 user devstack@n-api.service[61653]: Content-Length: 74 Apr 13 20:30:10 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:30:10 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:30:10 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:30:10 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGTHgU60gk6XNAecNfjeV73oUVK3OFrxGuyxBDmBdpLccBf10jTlE1CaE_8bPrOXWx15S3RgKgr1HUp5WGNhons5akLZT2gu7-Lydy2p8O9V3IRTJEtQnypqwv35JAR3FcpsnAbcjx6JdBEO9GPBYvn3J-f139TWaVCNjyaFWyVSeZU Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Project-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}] Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Tenant-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:30:10 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:30:10 user devstack@n-api.service[61653]: X-User: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:30:10 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:30:10 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:30:10 user devstack@n-api.service[61653]: X-User-Id: c89de9f7e5014fa8b0ff7b808bedfb91 Apr 13 20:30:10 user devstack@n-api.service[61653]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:30:10 user devstack@n-api.service[61653]: Apr 13 20:30:10 user devstack@n-api.service[61653]: {"volumeAttachment": {"volumeId": "6edd1f88-ac53-4939-bda8-764647abbef4"}} Apr 13 20:30:10 user devstack@n-api.service[61653]: method: > Apr 13 20:30:10 user devstack@n-api.service[61653]: exception: Cannot 'attach_volume' instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e while it is in vm_state rescued Apr 13 20:30:10 user devstack@n-api.service[61653]: action_args: {'server_id': '00d20026-e9af-4587-8930-d3dcfdb1ea3e', 'body': {'volumeAttachment': {'volumeId': '6edd1f88-ac53-4939-bda8-764647abbef4'}}} Apr 13 20:30:10 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e while it is in vm_state rescued Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e while it is in vm_state rescued Apr 13 20:30:10 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Returning 409 to user: Cannot 'attach_volume' instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e while it is in vm_state rescued {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:30:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3921fe29-1841-43ee-9d70-67e22c883fb9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047870 Apr 13 20:30:10 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 184/549] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:30:10 2023] POST /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 20:30:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:10 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e/action" status: 202 len: 0 microversion: 2.1 time: 0.080548 Apr 13 20:30:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 183/550] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:30:10 2023] POST /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 20:30:10 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:10 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:11 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ec3f6d9b-a024-48c8-b863-f8652691c025 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 200 len: 1498 microversion: 2.1 time: 0.166689 Apr 13 20:30:11 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 184/551] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:10 2023] GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:30:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-unplugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] Creating event network-vif-unplugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:30:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029262 Apr 13 20:30:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 185/552] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:13 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:14 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-plugged", "status": "completed", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] Creating event network-vif-plugged:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:30:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038210 Apr 13 20:30:14 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 184/553] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:14 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:14 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:30:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032712 Apr 13 20:30:14 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 185/554] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-plugged", "status": "completed", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] Creating event network-vif-plugged:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:30:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029718 Apr 13 20:30:16 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 186/555] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:16 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}, {"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:30:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:30:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031892 Apr 13 20:30:16 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 185/556] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:16 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:17 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:17 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-67bcc5ca-e524-4343-8db4-ef0a0e8af348 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1584 microversion: 2.1 time: 0.137009 Apr 13 20:30:17 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 186/557] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:16 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1584 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:18 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:18 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] Creating event network-changed:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:30:18 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034610 Apr 13 20:30:18 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 187/558] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:20 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-895653031"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:20 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:20 user devstack@n-api.service[61655]: INFO nova.network.security_group_api [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Adding security group 127faed3-a746-48d0-bad3-8cadac94238f to port 616b4969-2bbc-47cf-ac86-236d2fb36468 Apr 13 20:30:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-365ae4c0-298e-466e-b37f-f2684a13805a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/action" status: 202 len: 0 microversion: 2.1 time: 0.631826 Apr 13 20:30:20 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 186/559] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:30:20 2023] POST /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:30:20 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:20 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] Creating event network-changed:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:30:20 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034147 Apr 13 20:30:20 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 187/560] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:20 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7b88b88c-973e-4c4e-83a4-aefa9e07e7cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1749 microversion: 2.1 time: 0.213092 Apr 13 20:30:20 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 188/561] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:20 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1749 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:23 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:23 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/action" status: 202 len: 0 microversion: 2.1 time: 0.091616 Apr 13 20:30:23 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 187/562] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:30:23 2023] POST /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:23 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:23 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b069bf0e-a22b-4e51-9bf6-7114bd7077f5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1751 microversion: 2.1 time: 0.159875 Apr 13 20:30:23 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 188/563] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:23 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-unplugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:24 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] Creating event network-vif-unplugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:30:24 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031901 Apr 13 20:30:24 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 189/564] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:30:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030419 Apr 13 20:30:26 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 188/565] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:28 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:30:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058637 Apr 13 20:30:28 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 189/566] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:30:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036049 Apr 13 20:30:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 190/567] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=19 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:33 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:33 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-9bc84ce1-28e6-4b90-8c26-3d0e6e1250e1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1654 microversion: 2.1 time: 0.190489 Apr 13 20:30:33 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 189/568] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:33 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1654 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:30:36 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b HTTP/1.1 Apr 13 20:30:36 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:30:36 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:30:36 user devstack@n-api.service[61654]: Connection: close Apr 13 20:30:36 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:30:36 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:30:36 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:30:36 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:30:36 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:30:36 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:30:36 user devstack@n-api.service[61654]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:30:36 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:30:36 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:30:36 user devstack@n-api.service[61654]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:30:36 user devstack@n-api.service[61654]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:30:36 user devstack@n-api.service[61654]: method: > Apr 13 20:30:36 user devstack@n-api.service[61654]: exception: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:30:36 user devstack@n-api.service[61654]: action_args: {'id': 'a369e185-3d75-4dde-8e8a-0e397aab892b'} Apr 13 20:30:36 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:30:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:30:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:30:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7a0228d3-16c8-4c9d-82ac-e8584b689e8f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b" status: 404 len: 111 microversion: 2.1 time: 0.036588 Apr 13 20:30:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 190/569] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:36 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:30:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b255190e-20be-42cd-95f3-3691a88c743e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '.version_select at 0x7f7833d62560>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:36 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=21 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b255190e-20be-42cd-95f3-3691a88c743e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460582492" status: 202 len: 0 microversion: 2.1 time: 0.027213 Apr 13 20:30:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 191/570] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 20:30:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460582492 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:30:37 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2f34ad9b-e707-4dd2-9796-a26403101928 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: .version_select at 0x7f7833d8e950>, body: {"keypair": {"name": "tempest-keypair-867771061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCCX8u6zrg58hMYOqDCcBgm5ASAk29l64hwlQHGPn9hPSMp9xxNJqil1FLSEZAMwckiBv6hluknAtYjB8bLkAob+IHrbZEf2TIRzSS4TuOzVhrYWPg4XCtNFAg2iOzRag=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:37 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-2f34ad9b-e707-4dd2-9796-a26403101928 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for project 053f656470d94d2a9140f393bad01000. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:30:37 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-2f34ad9b-e707-4dd2-9796-a26403101928 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for user 49383d6f0e7141548370d8bc3b96dfd9 and project 053f656470d94d2a9140f393bad01000. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:30:37 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2f34ad9b-e707-4dd2-9796-a26403101928 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045020 Apr 13 20:30:37 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 190/571] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:30:37 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-33634037", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4a18c4c0-217f-4ba3-96d6-c37b108efca9"}], "security_groups": [{"name": "tempest-securitygroup--1944657611"}], "key_name": "tempest-keypair-867771061", "user_data": "}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] validate_networks() for [('4a18c4c0-217f-4ba3-96d6-c37b108efca9', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for project 053f656470d94d2a9140f393bad01000. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for user 49383d6f0e7141548370d8bc3b96dfd9 and project 053f656470d94d2a9140f393bad01000. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:30:39 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:30:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.544768 Apr 13 20:30:39 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 191/572] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:30:39 2023] POST /compute/v2.1/servers => generated 400 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:30:39 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6b773c1a-8e01-44c8-8377-75bf95bb986f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:39 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6b773c1a-8e01-44c8-8377-75bf95bb986f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:39 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-6b773c1a-8e01-44c8-8377-75bf95bb986f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:39 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6b773c1a-8e01-44c8-8377-75bf95bb986f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5" status: 200 len: 1233 microversion: 2.1 time: 0.095915 Apr 13 20:30:39 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 192/573] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:39 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 => generated 1233 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8acd3c03-8835-4b69-aabd-7a5a34b910d5", "tag": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] Creating event network-changed:e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 on user Apr 13 20:30:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033092 Apr 13 20:30:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 191/574] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:44 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8acd3c03-8835-4b69-aabd-7a5a34b910d5", "name": "network-vif-plugged", "status": "completed", "tag": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:44 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] Creating event network-vif-plugged:e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 on user Apr 13 20:30:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097688 Apr 13 20:30:44 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 192/575] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8acd3c03-8835-4b69-aabd-7a5a34b910d5", "name": "network-vif-plugged", "status": "completed", "tag": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:46 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] Creating event network-vif-plugged:e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 on user Apr 13 20:30:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067278 Apr 13 20:30:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 193/576] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:47 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'services' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:30:47 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments/1017ad5b-45cd-4f0b-a368-4af26c71c74c" status: 202 len: 0 microversion: 2.1 time: 0.174155 Apr 13 20:30:47 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 192/577] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:30:47 2023] DELETE /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments/1017ad5b-45cd-4f0b-a368-4af26c71c74c => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:47 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=24 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6a55a41a-f7bf-4bbd-a302-7dc32c916c17 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053242 Apr 13 20:30:47 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 193/578] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:30:47 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:51 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:51 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3d94fd7c-80eb-426c-87d7-9ddc9f358ccf tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-850008740", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "89a0e641-f418-4fdd-8f20-480666e0188c", "destination_type": "local"}, {"source_type": "volume", "uuid": "c19a6aaa-9813-4228-ac80-8d4e6f81440c", "destination_type": "invalid"}], "networks": [{"uuid": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba"}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:51 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3d94fd7c-80eb-426c-87d7-9ddc9f358ccf tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Request method failure captured: Apr 13 20:30:51 user devstack@n-api.service[61653]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 20:30:51 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:30:51 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:30:51 user devstack@n-api.service[61653]: Connection: close Apr 13 20:30:51 user devstack@n-api.service[61653]: Content-Length: 493 Apr 13 20:30:51 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:30:51 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:30:51 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:30:51 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGSy0RRVrvbeuhV0rDQ0vFk4saltPGHtuhgzpETnNmsVIOBVVJHkz1GIW-OaHmWcK9l5MjeE7cMI99YF9o7TaSHLlQnYMVkEi53CyqgchxqgboFQGFW9pSyvlk6YBgOrTqNFMj5JIrvJWZEvY3TtnUdGNLiHdr-r3yNHDOm3LI1VOKk Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Project-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/376fa6e005894aee80e4398704d956a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}] Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Tenant: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Tenant-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:30:51 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:30:51 user devstack@n-api.service[61653]: X-User: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:30:51 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:30:51 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:30:51 user devstack@n-api.service[61653]: X-User-Id: e39152c6dfed4218aa473532c49844ff Apr 13 20:30:51 user devstack@n-api.service[61653]: X-User-Name: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:30:51 user devstack@n-api.service[61653]: Apr 13 20:30:51 user devstack@n-api.service[61653]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-850008740", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "89a0e641-f418-4fdd-8f20-480666e0188c", "destination_type": "local"}, {"source_type": "volume", "uuid": "c19a6aaa-9813-4228-ac80-8d4e6f81440c", "destination_type": "invalid"}], "networks": [{"uuid": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba"}]}} Apr 13 20:30:51 user devstack@n-api.service[61653]: method: > Apr 13 20:30:51 user devstack@n-api.service[61653]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 20:30:51 user devstack@n-api.service[61653]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-850008740', 'imageRef': '89a0e641-f418-4fdd-8f20-480666e0188c', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '89a0e641-f418-4fdd-8f20-480666e0188c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c19a6aaa-9813-4228-ac80-8d4e6f81440c', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba'}]}}} Apr 13 20:30:51 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise error Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi 'invalid' Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 20:30:51 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:30:51 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3d94fd7c-80eb-426c-87d7-9ddc9f358ccf tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:30:51 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3d94fd7c-80eb-426c-87d7-9ddc9f358ccf tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018975 Apr 13 20:30:51 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 194/579] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:30:51 2023] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:51 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-be310646-66d3-4948-a750-88823394972f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 200 len: 1494 microversion: 2.1 time: 0.143720 Apr 13 20:30:51 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 193/580] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:51 2023] GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 1494 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-3e340f9c-db3d-4a60-9968-f3f8fa39c015 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 200 len: 1378 microversion: 2.1 time: 0.256657 Apr 13 20:30:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 194/581] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:55 2023] GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 1378 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:55 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-bdd475ae-a211-4899-9749-e76a93c5a53f tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 200 len: 1707 microversion: 2.20 time: 0.232559 Apr 13 20:30:55 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 195/582] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:30:55 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 1707 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-fed6b02a-b615-444b-b8ab-4fd12fb97f00 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 200 len: 1378 microversion: 2.1 time: 0.136910 Apr 13 20:30:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 194/583] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:55 2023] GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 1378 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:30:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 204 len: 0 microversion: 2.1 time: 0.117805 Apr 13 20:30:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 195/584] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:30:55 2023] DELETE /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:55 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:30:55 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-617a15ae-92ac-4367-b6c6-4738696fd60d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 200 len: 1384 microversion: 2.1 time: 0.154199 Apr 13 20:30:55 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 196/585] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:30:55 2023] GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 1384 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:30:56 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee274ffc-0455-4733-8a69-33f1210ed781", "name": "network-vif-unplugged", "status": "completed", "tag": "7a7478fd-2933-48b0-acdb-1bab32cefd46"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] Creating event network-vif-unplugged:7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance ee274ffc-0455-4733-8a69-33f1210ed781 on user Apr 13 20:30:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028842 Apr 13 20:30:56 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 195/586] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:57 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee274ffc-0455-4733-8a69-33f1210ed781", "name": "network-vif-deleted", "tag": "7a7478fd-2933-48b0-acdb-1bab32cefd46"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] Creating event network-vif-deleted:7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance ee274ffc-0455-4733-8a69-33f1210ed781 on user Apr 13 20:30:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036443 Apr 13 20:30:57 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 196/587] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:30:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee274ffc-0455-4733-8a69-33f1210ed781", "name": "network-vif-plugged", "status": "completed", "tag": "7a7478fd-2933-48b0-acdb-1bab32cefd46"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:30:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:30:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:30:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:30:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] Creating event network-vif-plugged:7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance ee274ffc-0455-4733-8a69-33f1210ed781 on user Apr 13 20:30:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037598 Apr 13 20:30:58 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 197/588] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:30:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:01 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7376964e-5761-4056-8d0b-de2d1fb798cd tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 200 len: 1504 microversion: 2.1 time: 0.149368 Apr 13 20:31:01 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 196/589] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:01 2023] GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:13 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:13 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-60b523bb-63b8-4c51-926a-f84e6dbb1187 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1749 microversion: 2.1 time: 0.182159 Apr 13 20:31:13 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 197/590] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:13 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1749 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=16 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:30 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b9e59085-23ce-469d-9ed2-fc458e8b4b2a tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5" status: 200 len: 1542 microversion: 2.1 time: 0.177013 Apr 13 20:31:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 198/591] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:29 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 => generated 1542 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b0dc6b5b-0f6e-4615-b80c-5a5652236b84 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047167 Apr 13 20:31:34 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 197/592] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:31:34 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:34 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:31:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 204 len: 0 microversion: 2.1 time: 0.140731 Apr 13 20:31:34 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 198/593] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:31:34 2023] DELETE /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:34 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-408738d5-37d4-4708-bcb6-d080e9e55c0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 200 len: 1660 microversion: 2.1 time: 0.165041 Apr 13 20:31:34 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 199/594] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:34 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 1660 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-unplugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] Creating event network-vif-unplugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:31:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031980 Apr 13 20:31:34 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 198/595] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:31:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:31:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}, {"server_uuid": "7d01394e-edb8-4c51-a71a-e07c0ee164db", "name": "network-vif-deleted", "tag": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:31:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Creating event network-vif-plugged:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:31:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Creating event network-vif-deleted:b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db on user Apr 13 20:31:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031310 Apr 13 20:31:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 199/596] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:31:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:37 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6dcdcea5-7b1f-4193-8511-a3c297888236 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047148 Apr 13 20:31:37 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 200/597] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:31:37 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:37 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:37 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a79fe52f-2dbd-48ed-9a06-d53ae9e06393 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1675 microversion: 2.1 time: 0.177015 Apr 13 20:31:37 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 199/598] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:37 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:37 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:37 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ffb0acf5-2610-426f-b92d-b60e675c596b tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1675 microversion: 2.1 time: 0.181278 Apr 13 20:31:37 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 200/599] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:37 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:38 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-12dd954e-5b10-46ba-ab61-e759020b6b5a tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1675 microversion: 2.1 time: 0.144781 Apr 13 20:31:38 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 201/600] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:37 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:31:46 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 HTTP/1.1 Apr 13 20:31:46 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:31:46 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:31:46 user devstack@n-api.service[61655]: Connection: close Apr 13 20:31:46 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:31:46 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:31:46 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:31:46 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:31:46 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:31:46 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61655]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:31:46 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:31:46 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:31:46 user devstack@n-api.service[61655]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:31:46 user devstack@n-api.service[61655]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:31:46 user devstack@n-api.service[61655]: method: > Apr 13 20:31:46 user devstack@n-api.service[61655]: exception: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61655]: action_args: {'id': 'ee274ffc-0455-4733-8a69-33f1210ed781'} Apr 13 20:31:46 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:31:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a37c3e5c-9a97-4615-ad51-4921cf594ec7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 404 len: 111 microversion: 2.1 time: 0.030781 Apr 13 20:31:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 200/601] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:46 2023] GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:31:46 user devstack@n-api.service[61654]: request: DELETE /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 HTTP/1.1 Apr 13 20:31:46 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:31:46 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:31:46 user devstack@n-api.service[61654]: Connection: close Apr 13 20:31:46 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:31:46 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:31:46 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:31:46 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:31:46 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:31:46 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61654]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:31:46 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:31:46 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:31:46 user devstack@n-api.service[61654]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:31:46 user devstack@n-api.service[61654]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:31:46 user devstack@n-api.service[61654]: method: > Apr 13 20:31:46 user devstack@n-api.service[61654]: exception: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61654]: action_args: {'id': 'ee274ffc-0455-4733-8a69-33f1210ed781'} Apr 13 20:31:46 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:31:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6436fb3a-fce5-42f6-9a89-ddbb68325d7f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 404 len: 111 microversion: 2.1 time: 0.031338 Apr 13 20:31:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 201/602] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:31:46 2023] DELETE /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:31:46 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 HTTP/1.1 Apr 13 20:31:46 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:31:46 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:31:46 user devstack@n-api.service[61653]: Connection: close Apr 13 20:31:46 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:31:46 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:31:46 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:31:46 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:31:46 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:31:46 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:31:46 user devstack@n-api.service[61653]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:31:46 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:31:46 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:31:46 user devstack@n-api.service[61653]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:31:46 user devstack@n-api.service[61653]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:31:46 user devstack@n-api.service[61653]: method: > Apr 13 20:31:46 user devstack@n-api.service[61653]: exception: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61653]: action_args: {'id': 'ee274ffc-0455-4733-8a69-33f1210ed781'} Apr 13 20:31:46 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. Apr 13 20:31:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:31:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:31:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2ab5d960-08eb-4c79-968c-61bf282f1e0c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781" status: 404 len: 111 microversion: 2.1 time: 0.035311 Apr 13 20:31:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 202/603] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:46 2023] GET /compute/v2.1/servers/ee274ffc-0455-4733-8a69-33f1210ed781 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-704536365", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "2b663208-c712-444c-9d05-1b84e247c6ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] validate_networks() for [('e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for user 7e478a11b57b4ee385e33c4709adf04b and project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:31:54 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b663208-c712-444c-9d05-1b84e247c6ac',volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:31:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.776936 Apr 13 20:31:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 201/604] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:31:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:31:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-be147670-6272-47bf-94b1-272731ccb141 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:55 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-be147670-6272-47bf-94b1-272731ccb141 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:55 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-be147670-6272-47bf-94b1-272731ccb141 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-be147670-6272-47bf-94b1-272731ccb141 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590" status: 200 len: 1065 microversion: 2.1 time: 0.071618 Apr 13 20:31:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 202/605] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:55 2023] GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 => generated 1065 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:55 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:55 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:55 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:55 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6d85dc3c-d0c6-4d72-a9c1-e0c9f948f8e7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052190 Apr 13 20:31:55 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 203/606] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 20:31:55 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:31:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 204 len: 0 microversion: 2.20 time: 0.112552 Apr 13 20:31:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 202/607] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:31:55 2023] DELETE /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:56 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-67344949-fe21-4b4f-9250-f4559a4e3603 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 200 len: 1713 microversion: 2.20 time: 0.169809 Apr 13 20:31:56 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 203/608] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:31:55 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:31:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-unplugged", "status": "completed", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:31:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] Creating event network-vif-unplugged:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:31:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031249 Apr 13 20:31:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 204/609] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:31:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] HTTP exception thrown: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Request method failure captured: Apr 13 20:31:58 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf HTTP/1.1 Apr 13 20:31:58 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:31:58 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:31:58 user devstack@n-api.service[61655]: Connection: close Apr 13 20:31:58 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:31:58 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:31:58 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:31:58 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:31:58 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGSy0RRVrvbeuhV0rDQ0vFk4saltPGHtuhgzpETnNmsVIOBVVJHkz1GIW-OaHmWcK9l5MjeE7cMI99YF9o7TaSHLlQnYMVkEi53CyqgchxqgboFQGFW9pSyvlk6YBgOrTqNFMj5JIrvJWZEvY3TtnUdGNLiHdr-r3yNHDOm3LI1VOKk Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Project-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/376fa6e005894aee80e4398704d956a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}] Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Tenant: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Tenant-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:31:58 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:31:58 user devstack@n-api.service[61655]: X-User: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:31:58 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:31:58 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:31:58 user devstack@n-api.service[61655]: X-User-Id: e39152c6dfed4218aa473532c49844ff Apr 13 20:31:58 user devstack@n-api.service[61655]: X-User-Name: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:31:58 user devstack@n-api.service[61655]: method: > Apr 13 20:31:58 user devstack@n-api.service[61655]: exception: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61655]: action_args: {'id': '31f49fca-6bb7-4297-b903-4c4ddbe325cf'} Apr 13 20:31:58 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Returning 404 to user: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:31:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6d18e66d-9c55-47f1-910c-403fc6b8c852 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf" status: 404 len: 111 microversion: 2.1 time: 0.040811 Apr 13 20:31:58 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 203/610] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:31:58 2023] DELETE /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] HTTP exception thrown: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Request method failure captured: Apr 13 20:31:58 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf HTTP/1.1 Apr 13 20:31:58 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:31:58 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:31:58 user devstack@n-api.service[61654]: Connection: close Apr 13 20:31:58 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:31:58 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:31:58 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:31:58 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:31:58 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGSy0RRVrvbeuhV0rDQ0vFk4saltPGHtuhgzpETnNmsVIOBVVJHkz1GIW-OaHmWcK9l5MjeE7cMI99YF9o7TaSHLlQnYMVkEi53CyqgchxqgboFQGFW9pSyvlk6YBgOrTqNFMj5JIrvJWZEvY3TtnUdGNLiHdr-r3yNHDOm3LI1VOKk Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Project-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Project-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/376fa6e005894aee80e4398704d956a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}] Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Tenant: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Tenant-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:31:58 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:31:58 user devstack@n-api.service[61654]: X-User: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:31:58 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:31:58 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:31:58 user devstack@n-api.service[61654]: X-User-Id: e39152c6dfed4218aa473532c49844ff Apr 13 20:31:58 user devstack@n-api.service[61654]: X-User-Name: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:31:58 user devstack@n-api.service[61654]: method: > Apr 13 20:31:58 user devstack@n-api.service[61654]: exception: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61654]: action_args: {'id': '31f49fca-6bb7-4297-b903-4c4ddbe325cf'} Apr 13 20:31:58 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. Apr 13 20:31:58 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Returning 404 to user: Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:31:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7b67495b-3b7e-4290-aded-194aa29bc840 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf" status: 404 len: 111 microversion: 2.1 time: 0.038791 Apr 13 20:31:58 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 204/611] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:58 2023] GET /compute/v2.1/servers/31f49fca-6bb7-4297-b903-4c4ddbe325cf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6800d3-8537-4a89-877a-c049f0670590", "tag": "d4d99364-e2da-4757-ab7c-38f903f15a19"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] Creating event network-changed:d4d99364-e2da-4757-ab7c-38f903f15a19 for instance 3e6800d3-8537-4a89-877a-c049f0670590 on user Apr 13 20:31:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 204 len: 0 microversion: 2.1 time: 0.165769 Apr 13 20:31:58 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 205/612] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:31:58 2023] DELETE /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:31:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033907 Apr 13 20:31:58 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 204/613] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:31:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-plugged", "status": "completed", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}, {"server_uuid": "4c067bb3-5a8d-4198-9b35-bf8dc2a98962", "name": "network-vif-deleted", "tag": "a573f361-5e24-4509-aa70-50df8b98cf0d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Creating event network-vif-plugged:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:31:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Creating event network-vif-deleted:a573f361-5e24-4509-aa70-50df8b98cf0d for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 on user Apr 13 20:31:58 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032980 Apr 13 20:31:58 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 206/614] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:31:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:31:58 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:31:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-60b2f285-8724-44d9-989f-67b443852652 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 200 len: 1500 microversion: 2.1 time: 0.278205 Apr 13 20:31:58 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 205/615] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:31:58 2023] GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 1500 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c6121a-c1be-467c-888f-1c42b03f95cf", "name": "network-vif-unplugged", "status": "completed", "tag": "5d781018-f7d5-445e-9d00-55c8ff93194c"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:31:58 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:31:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] Creating event network-vif-unplugged:5d781018-f7d5-445e-9d00-55c8ff93194c for instance 57c6121a-c1be-467c-888f-1c42b03f95cf on user Apr 13 20:31:58 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037448 Apr 13 20:31:58 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 205/616] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:31:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:00 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-6191f877-6d2b-4236-bcc4-42484d21216b req-70e5f930-74a9-4b43-adf2-70937d2fe8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c6121a-c1be-467c-888f-1c42b03f95cf", "name": "network-vif-deleted", "tag": "5d781018-f7d5-445e-9d00-55c8ff93194c"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:00 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:00 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6191f877-6d2b-4236-bcc4-42484d21216b req-70e5f930-74a9-4b43-adf2-70937d2fe8f1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:00 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6191f877-6d2b-4236-bcc4-42484d21216b req-70e5f930-74a9-4b43-adf2-70937d2fe8f1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:00 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6191f877-6d2b-4236-bcc4-42484d21216b req-70e5f930-74a9-4b43-adf2-70937d2fe8f1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:00 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:00 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-6191f877-6d2b-4236-bcc4-42484d21216b req-70e5f930-74a9-4b43-adf2-70937d2fe8f1 service nova] Creating event network-vif-deleted:5d781018-f7d5-445e-9d00-55c8ff93194c for instance 57c6121a-c1be-467c-888f-1c42b03f95cf on user Apr 13 20:32:00 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-6191f877-6d2b-4236-bcc4-42484d21216b req-70e5f930-74a9-4b43-adf2-70937d2fe8f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036993 Apr 13 20:32:00 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 207/617] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:00 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c6121a-c1be-467c-888f-1c42b03f95cf", "name": "network-vif-plugged", "status": "completed", "tag": "5d781018-f7d5-445e-9d00-55c8ff93194c"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:00 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] Creating event network-vif-plugged:5d781018-f7d5-445e-9d00-55c8ff93194c for instance 57c6121a-c1be-467c-888f-1c42b03f95cf on user Apr 13 20:32:00 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029329 Apr 13 20:32:00 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 206/618] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:02 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c79e3917-a6a9-4f69-b84e-0241c42e62ee tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'create', calling method: .version_select at 0x7f7833d8c700>, body: {"keypair": {"name": "tempest-keypair-768981879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB786rORhQxc4xur8ylm9URgCf1Ty59hjrLsa8BWuLoAgtAb3i83xpJ5ZXO+s/6wHVdt5Q/i+YiNlTUqN6RbDsKZfJ2v1Fjei+P1wDPDX400QY+aaJpsYbgDSONX/FKbA=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:02 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-c79e3917-a6a9-4f69-b84e-0241c42e62ee tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting quotas for project 89f747e06fa64492af3195a88e527bb3. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:32:02 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-c79e3917-a6a9-4f69-b84e-0241c42e62ee tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting quotas for user c89de9f7e5014fa8b0ff7b808bedfb91 and project 89f747e06fa64492af3195a88e527bb3. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:32:02 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c79e3917-a6a9-4f69-b84e-0241c42e62ee tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053440 Apr 13 20:32:02 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 206/619] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:32:02 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6800d3-8537-4a89-877a-c049f0670590", "name": "network-vif-plugged", "status": "completed", "tag": "d4d99364-e2da-4757-ab7c-38f903f15a19"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] Creating event network-vif-plugged:d4d99364-e2da-4757-ab7c-38f903f15a19 for instance 3e6800d3-8537-4a89-877a-c049f0670590 on user Apr 13 20:32:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075411 Apr 13 20:32:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 208/620] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-675837111", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fcb01a90-9ce8-48cc-af1d-862288650760"}], "security_groups": [{"name": "tempest-securitygroup--526549592"}], "key_name": "tempest-keypair-768981879", "user_data": "}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:04 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:04 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] validate_networks() for [('fcb01a90-9ce8-48cc-af1d-862288650760', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:32:04 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:32:04 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:32:04 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:32:04 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:32:04 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting quotas for project 89f747e06fa64492af3195a88e527bb3. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting quotas for user c89de9f7e5014fa8b0ff7b808bedfb91 and project 89f747e06fa64492af3195a88e527bb3. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:32:05 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:32:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.735949 Apr 13 20:32:05 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 207/621] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:32:04 2023] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:32:05 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:05 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7c9c96e7-1159-4e49-be21-c18e897dcc1f tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:05 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7c9c96e7-1159-4e49-be21-c18e897dcc1f tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:05 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:05 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7c9c96e7-1159-4e49-be21-c18e897dcc1f tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:32:05 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7c9c96e7-1159-4e49-be21-c18e897dcc1f tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 200 len: 1238 microversion: 2.1 time: 0.067136 Apr 13 20:32:05 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 207/622] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:32:05 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:32:06 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6800d3-8537-4a89-877a-c049f0670590", "name": "network-vif-plugged", "status": "completed", "tag": "d4d99364-e2da-4757-ab7c-38f903f15a19"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] Creating event network-vif-plugged:d4d99364-e2da-4757-ab7c-38f903f15a19 for instance 3e6800d3-8537-4a89-877a-c049f0670590 on user Apr 13 20:32:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033645 Apr 13 20:32:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 209/623] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:07 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] Creating event network-changed:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:32:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038408 Apr 13 20:32:07 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 208/624] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:09 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:32:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047411 Apr 13 20:32:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 208/625] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:11 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:11 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:32:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Apr 13 20:32:11 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 210/626] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-895653031"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:14 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:14 user devstack@n-api.service[61654]: INFO nova.network.security_group_api [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Removing security group 127faed3-a746-48d0-bad3-8cadac94238f from port 616b4969-2bbc-47cf-ac86-236d2fb36468 Apr 13 20:32:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-affb81fb-b127-4517-b9a1-7ea26857e6cb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/action" status: 202 len: 0 microversion: 2.1 time: 0.609372 Apr 13 20:32:14 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 209/627] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:32:14 2023] POST /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:32:14 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] Creating event network-changed:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:32:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056737 Apr 13 20:32:14 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 209/628] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:15 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:15 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:15 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] Creating event network-changed:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:32:15 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039916 Apr 13 20:32:15 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 211/629] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:15 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'services' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:32:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments/80e647b5-ac5e-491b-acfc-32f350f2cc4a" status: 202 len: 0 microversion: 2.1 time: 0.221481 Apr 13 20:32:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 210/630] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:32:15 2023] DELETE /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments/80e647b5-ac5e-491b-acfc-32f350f2cc4a => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:32:15 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=12 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:15 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:15 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-311859cc-50d1-43ad-ad60-b21a48cb8c47 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059976 Apr 13 20:32:16 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 210/631] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:32:15 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:24 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HTTP exception thrown: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Request method failure captured: Apr 13 20:32:24 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db HTTP/1.1 Apr 13 20:32:24 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:32:24 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:32:24 user devstack@n-api.service[61653]: Connection: close Apr 13 20:32:24 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:32:24 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:32:24 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:32:24 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:32:24 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGRnQSlvJY0liyePr87QQ6EZxvOc4whutvpJuaojawTt6Mlq1K3YtHnK7YYqZJjb2NpmK1Ki4xPIWYsVmPk1IjDfWG_mIO31eL42Qk8-aiS5fwwTSafQ1vIHcrck2B4UTeIubNXdQE7nPCVmK8iQgWV1hsVNPERJNKqQE1EWPAqCXyA Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Project-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}] Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Tenant-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:32:24 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:32:24 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:32:24 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:32:24 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:32:24 user devstack@n-api.service[61653]: X-User-Id: b5210a73b1574e82838f3f0ccef93a25 Apr 13 20:32:24 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:32:24 user devstack@n-api.service[61653]: method: > Apr 13 20:32:24 user devstack@n-api.service[61653]: exception: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:32:24 user devstack@n-api.service[61653]: action_args: {'id': '7d01394e-edb8-4c51-a71a-e07c0ee164db'} Apr 13 20:32:24 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:32:24 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Returning 404 to user: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:32:24 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-bb15a75f-3a29-4652-ba97-27d28aa8254a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 404 len: 111 microversion: 2.1 time: 0.035241 Apr 13 20:32:24 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 212/632] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:32:24 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:32:24 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-29aa67f5-b749-485a-9e3f-c09d33e19a0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '.version_select at 0x7f7833fea7a0>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-29aa67f5-b749-485a-9e3f-c09d33e19a0a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262567265" status: 202 len: 0 microversion: 2.1 time: 0.030654 Apr 13 20:32:24 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 211/633] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 20:32:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262567265 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:32:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-911ff448-dc83-43e6-a0c2-6eeca3f40cf7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'create', calling method: .version_select at 0x7f7833ecfd90>, body: {"keypair": {"name": "tempest-keypair-677859878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxyFfcxKO+lPHZHZA8kfKWxEvzIV81dWX33k2emGB4oNguvST61Qj6LSYBEY1hzgxv/SRx/KGzUsi/U1+Fbxx3iIU9HdkWNMNVlsH3GSLEvkEFJlhr8lbeYflCzZq2JAQ=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:25 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-911ff448-dc83-43e6-a0c2-6eeca3f40cf7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting quotas for project 587bca93ee3f45b9b5b1ceb91e972e7b. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:32:25 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-911ff448-dc83-43e6-a0c2-6eeca3f40cf7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting quotas for user b5210a73b1574e82838f3f0ccef93a25 and project 587bca93ee3f45b9b5b1ceb91e972e7b. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:32:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-911ff448-dc83-43e6-a0c2-6eeca3f40cf7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043361 Apr 13 20:32:25 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 211/634] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:32:25 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:26 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-758761895", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8ae2ae85-3644-4f35-bc04-a6af1ace6265"}], "security_groups": [{"name": "tempest-securitygroup--892510306"}], "key_name": "tempest-keypair-677859878", "user_data": "}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] validate_networks() for [('8ae2ae85-3644-4f35-bc04-a6af1ace6265', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting quotas for project 587bca93ee3f45b9b5b1ceb91e972e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting quotas for user b5210a73b1574e82838f3f0ccef93a25 and project 587bca93ee3f45b9b5b1ceb91e972e7b. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:32:27 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:32:27 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.652349 Apr 13 20:32:27 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 213/635] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:32:26 2023] POST /compute/v2.1/servers => generated 399 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:32:27 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:27 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-5f664686-7797-45e6-b19e-44b36c58e44a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:27 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-5f664686-7797-45e6-b19e-44b36c58e44a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:27 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-5f664686-7797-45e6-b19e-44b36c58e44a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:32:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-5f664686-7797-45e6-b19e-44b36c58e44a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77" status: 200 len: 1230 microversion: 2.1 time: 0.074803 Apr 13 20:32:27 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 212/636] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:32:27 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 => generated 1230 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:32:29 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=10 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06095354-ac91-443e-8181-dfa44a14ba77", "tag": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] Creating event network-changed:0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance 06095354-ac91-443e-8181-dfa44a14ba77 on user Apr 13 20:32:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031742 Apr 13 20:32:29 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 212/637] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:30 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-10c1d3a5-b291-496b-8382-e3465c4b1c70 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.123759 Apr 13 20:32:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 214/638] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:32:30 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-interface => generated 282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:31 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:31 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:31 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8acd3c03-8835-4b69-aabd-7a5a34b910d5", "tag": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:31 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-78dc3676-b675-432d-8888-fb601c8f3f6e tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/ips" status: 200 len: 107 microversion: 2.1 time: 0.067718 Apr 13 20:32:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:31 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 213/639] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:32:31 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/ips => generated 107 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:31 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] Creating event network-changed:e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 on user Apr 13 20:32:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053116 Apr 13 20:32:32 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 213/640] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:32 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06095354-ac91-443e-8181-dfa44a14ba77", "name": "network-vif-plugged", "status": "completed", "tag": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:32 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:32 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=18 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] Creating event network-vif-plugged:0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance 06095354-ac91-443e-8181-dfa44a14ba77 on user Apr 13 20:32:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077477 Apr 13 20:32:32 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 215/641] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06095354-ac91-443e-8181-dfa44a14ba77", "name": "network-vif-plugged", "status": "completed", "tag": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] Creating event network-vif-plugged:0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance 06095354-ac91-443e-8181-dfa44a14ba77 on user Apr 13 20:32:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036420 Apr 13 20:32:34 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 214/642] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:32:34 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19a92049-37e4-4d45-99ea-e2863952fb31"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:34 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279844 Apr 13 20:32:34 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 214/643] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:32:34 2023] POST /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:40 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:32:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-99fb7520-45f6-4a58-8853-59290870ad41 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1675 microversion: 2.1 time: 0.217157 Apr 13 20:32:40 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 216/644] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:32:40 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:41 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287340 Apr 13 20:32:41 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 215/645] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:32:40 2023] POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19a92049-37e4-4d45-99ea-e2863952fb31"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Invalid volume: volume 19a92049-37e4-4d45-99ea-e2863952fb31 is already attached to instances: 8acd3c03-8835-4b69-aabd-7a5a34b910d5 Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:32:42 user devstack@n-api.service[61655]: request: POST /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments HTTP/1.1 Apr 13 20:32:42 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:32:42 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:32:42 user devstack@n-api.service[61655]: Connection: close Apr 13 20:32:42 user devstack@n-api.service[61655]: Content-Length: 74 Apr 13 20:32:42 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:32:42 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:32:42 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:32:42 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:32:42 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:32:42 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:32:42 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:32:42 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:32:42 user devstack@n-api.service[61655]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:32:42 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:32:42 user devstack@n-api.service[61655]: Apr 13 20:32:42 user devstack@n-api.service[61655]: {"volumeAttachment": {"volumeId": "19a92049-37e4-4d45-99ea-e2863952fb31"}} Apr 13 20:32:42 user devstack@n-api.service[61655]: method: > Apr 13 20:32:42 user devstack@n-api.service[61655]: exception: Invalid volume: volume 19a92049-37e4-4d45-99ea-e2863952fb31 is already attached to instances: 8acd3c03-8835-4b69-aabd-7a5a34b910d5 Apr 13 20:32:42 user devstack@n-api.service[61655]: action_args: {'server_id': '8acd3c03-8835-4b69-aabd-7a5a34b910d5', 'body': {'volumeAttachment': {'volumeId': '19a92049-37e4-4d45-99ea-e2863952fb31'}}} Apr 13 20:32:42 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 19a92049-37e4-4d45-99ea-e2863952fb31 is already attached to instances: 8acd3c03-8835-4b69-aabd-7a5a34b910d5 Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 19a92049-37e4-4d45-99ea-e2863952fb31 is already attached to instances: 8acd3c03-8835-4b69-aabd-7a5a34b910d5 Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 19a92049-37e4-4d45-99ea-e2863952fb31 is already attached to instances: 8acd3c03-8835-4b69-aabd-7a5a34b910d5 Apr 13 20:32:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 400 to user: Invalid volume: volume 19a92049-37e4-4d45-99ea-e2863952fb31 is already attached to instances: 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:32:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d9a58754-eda0-4815-ae99-7513a97fd0f9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106493 Apr 13 20:32:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 215/646] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:32:42 2023] POST /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:42 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'services' on Instance uuid 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:32:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments/19a92049-37e4-4d45-99ea-e2863952fb31" status: 202 len: 0 microversion: 2.1 time: 0.198768 Apr 13 20:32:42 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 217/647] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:32:42 2023] DELETE /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments/19a92049-37e4-4d45-99ea-e2863952fb31 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:32:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:42 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b0b58e4f-b20d-4b9c-8c12-8c37a8997d81 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063411 Apr 13 20:32:42 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 216/648] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:32:42 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:45 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:32:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7fcfa200-dc98-48b4-a5d0-61e8cc267ecb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590" status: 200 len: 1392 microversion: 2.1 time: 0.222682 Apr 13 20:32:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 216/649] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:32:45 2023] GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] HTTP exception thrown: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Request method failure captured: Apr 13 20:32:46 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 HTTP/1.1 Apr 13 20:32:46 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:32:46 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:32:46 user devstack@n-api.service[61653]: Connection: close Apr 13 20:32:46 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:32:46 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:32:46 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:32:46 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:32:46 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOmzq0nwiJsCk00XiqmpX0ELkLMYn5tl5KYt34xhUMwtWAy_Rb2wo2L1baLmjq7xTp1JUJpITDivM3g4D2M-lNlY1EeA3Hejtk7OWPIKCdIgZJ9aZBzBhJ6jqRKWYuX9p2DdHywy53J4QMsLD9rRmTXVHnf9NGiVcYViLsNOtOh4WI Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Project-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/405aed9fca044ab39eabe188942230d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}] Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Tenant-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:46 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:46 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:46 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:32:46 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:32:46 user devstack@n-api.service[61653]: X-User-Id: 36e11efc98604eb7a8d5b95563431e45 Apr 13 20:32:46 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:46 user devstack@n-api.service[61653]: method: > Apr 13 20:32:46 user devstack@n-api.service[61653]: exception: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:46 user devstack@n-api.service[61653]: action_args: {'id': '4c067bb3-5a8d-4198-9b35-bf8dc2a98962'} Apr 13 20:32:46 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Returning 404 to user: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:32:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6b00b412-e607-48ce-928d-1b99dc267abe tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 404 len: 111 microversion: 2.20 time: 0.031858 Apr 13 20:32:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 218/650] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:32:46 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:32:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-0cb7eff9-8753-4d91-a34d-2ee22927d2c5 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '.version_select at 0x7f7833e7e7a0>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-0cb7eff9-8753-4d91-a34d-2ee22927d2c5 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-103925243" status: 204 len: 0 microversion: 2.20 time: 0.021863 Apr 13 20:32:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 217/651] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 20:32:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-103925243 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:48 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] HTTP exception thrown: Instance 57c6121a-c1be-467c-888f-1c42b03f95cf could not be found. Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Request method failure captured: Apr 13 20:32:48 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf HTTP/1.1 Apr 13 20:32:48 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:32:48 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:32:48 user devstack@n-api.service[61653]: Connection: close Apr 13 20:32:48 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:32:48 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:32:48 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:32:48 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:32:48 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGSy0RRVrvbeuhV0rDQ0vFk4saltPGHtuhgzpETnNmsVIOBVVJHkz1GIW-OaHmWcK9l5MjeE7cMI99YF9o7TaSHLlQnYMVkEi53CyqgchxqgboFQGFW9pSyvlk6YBgOrTqNFMj5JIrvJWZEvY3TtnUdGNLiHdr-r3yNHDOm3LI1VOKk Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Project-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/376fa6e005894aee80e4398704d956a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/376fa6e005894aee80e4398704d956a7"}]}] Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Tenant: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Tenant-Id: 376fa6e005894aee80e4398704d956a7 Apr 13 20:32:48 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1377252178 Apr 13 20:32:48 user devstack@n-api.service[61653]: X-User: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:32:48 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:32:48 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:32:48 user devstack@n-api.service[61653]: X-User-Id: e39152c6dfed4218aa473532c49844ff Apr 13 20:32:48 user devstack@n-api.service[61653]: X-User-Name: tempest-ServersNegativeTestJSON-1377252178-project-member Apr 13 20:32:48 user devstack@n-api.service[61653]: method: > Apr 13 20:32:48 user devstack@n-api.service[61653]: exception: Instance 57c6121a-c1be-467c-888f-1c42b03f95cf could not be found. Apr 13 20:32:48 user devstack@n-api.service[61653]: action_args: {'id': '57c6121a-c1be-467c-888f-1c42b03f95cf'} Apr 13 20:32:48 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c6121a-c1be-467c-888f-1c42b03f95cf could not be found. Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c6121a-c1be-467c-888f-1c42b03f95cf could not be found. Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c6121a-c1be-467c-888f-1c42b03f95cf could not be found. Apr 13 20:32:48 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:48 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Returning 404 to user: Instance 57c6121a-c1be-467c-888f-1c42b03f95cf could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:32:48 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3e57b136-59c9-4126-840b-82108c4435cb tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf" status: 404 len: 111 microversion: 2.1 time: 0.028508 Apr 13 20:32:48 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 219/652] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:32:48 2023] GET /compute/v2.1/servers/57c6121a-c1be-467c-888f-1c42b03f95cf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Old instance type m1.nano, new instance type m1.micro {{(pid=61655) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for user 04d351d2822a460d93748b98161d730c and project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:32:48 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:32:48 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/action" status: 202 len: 0 microversion: 2.1 time: 0.288982 Apr 13 20:32:48 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 217/653] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:32:48 2023] POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] HTTP exception thrown: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Request method failure captured: Apr 13 20:32:49 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 HTTP/1.1 Apr 13 20:32:49 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:32:49 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:32:49 user devstack@n-api.service[61653]: Connection: close Apr 13 20:32:49 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:32:49 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:32:49 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:32:49 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:32:49 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOmzq0nwiJsCk00XiqmpX0ELkLMYn5tl5KYt34xhUMwtWAy_Rb2wo2L1baLmjq7xTp1JUJpITDivM3g4D2M-lNlY1EeA3Hejtk7OWPIKCdIgZJ9aZBzBhJ6jqRKWYuX9p2DdHywy53J4QMsLD9rRmTXVHnf9NGiVcYViLsNOtOh4WI Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Project-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/405aed9fca044ab39eabe188942230d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}] Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Tenant-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:49 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:49 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:49 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:32:49 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:32:49 user devstack@n-api.service[61653]: X-User-Id: 36e11efc98604eb7a8d5b95563431e45 Apr 13 20:32:49 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:49 user devstack@n-api.service[61653]: method: > Apr 13 20:32:49 user devstack@n-api.service[61653]: exception: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61653]: action_args: {'id': '4c067bb3-5a8d-4198-9b35-bf8dc2a98962'} Apr 13 20:32:49 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Returning 404 to user: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:32:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-30fec575-bf99-4edf-bea3-808560585311 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 404 len: 111 microversion: 2.20 time: 0.057141 Apr 13 20:32:49 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 220/654] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:32:49 2023] DELETE /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] HTTP exception thrown: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Request method failure captured: Apr 13 20:32:49 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 HTTP/1.1 Apr 13 20:32:49 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:32:49 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:32:49 user devstack@n-api.service[61655]: Connection: close Apr 13 20:32:49 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:32:49 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:32:49 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:32:49 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:32:49 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGOmzq0nwiJsCk00XiqmpX0ELkLMYn5tl5KYt34xhUMwtWAy_Rb2wo2L1baLmjq7xTp1JUJpITDivM3g4D2M-lNlY1EeA3Hejtk7OWPIKCdIgZJ9aZBzBhJ6jqRKWYuX9p2DdHywy53J4QMsLD9rRmTXVHnf9NGiVcYViLsNOtOh4WI Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Project-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/405aed9fca044ab39eabe188942230d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}] Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Tenant-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:49 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:49 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:49 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:32:49 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:32:49 user devstack@n-api.service[61655]: X-User-Id: 36e11efc98604eb7a8d5b95563431e45 Apr 13 20:32:49 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:49 user devstack@n-api.service[61655]: method: > Apr 13 20:32:49 user devstack@n-api.service[61655]: exception: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61655]: action_args: {'id': '4c067bb3-5a8d-4198-9b35-bf8dc2a98962'} Apr 13 20:32:49 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. Apr 13 20:32:49 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Returning 404 to user: Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:32:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7868269d-904d-4bea-91c8-5b344c298684 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962" status: 404 len: 111 microversion: 2.20 time: 0.027373 Apr 13 20:32:49 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 218/655] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:32:49 2023] GET /compute/v2.1/servers/4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:32:49 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:32:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-3cc922a9-1ea3-440f-b72e-8851d4861af8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1730 microversion: 2.1 time: 0.986346 Apr 13 20:32:49 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 218/656] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:32:48 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1730 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] HTTP exception thrown: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Request method failure captured: Apr 13 20:32:52 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 HTTP/1.1 Apr 13 20:32:52 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:32:52 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:32:52 user devstack@n-api.service[61653]: Connection: close Apr 13 20:32:52 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:32:52 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:32:52 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:32:52 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:32:52 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGOmzq0nwiJsCk00XiqmpX0ELkLMYn5tl5KYt34xhUMwtWAy_Rb2wo2L1baLmjq7xTp1JUJpITDivM3g4D2M-lNlY1EeA3Hejtk7OWPIKCdIgZJ9aZBzBhJ6jqRKWYuX9p2DdHywy53J4QMsLD9rRmTXVHnf9NGiVcYViLsNOtOh4WI Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Project-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/405aed9fca044ab39eabe188942230d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}] Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Tenant-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:52 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:52 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:52 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:32:52 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:32:52 user devstack@n-api.service[61653]: X-User-Id: 36e11efc98604eb7a8d5b95563431e45 Apr 13 20:32:52 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:52 user devstack@n-api.service[61653]: method: > Apr 13 20:32:52 user devstack@n-api.service[61653]: exception: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61653]: action_args: {'id': '2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9'} Apr 13 20:32:52 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Returning 404 to user: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:32:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-bfac4d37-8637-4509-b34a-2f393ddcb218 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 404 len: 111 microversion: 2.20 time: 0.050757 Apr 13 20:32:52 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 221/657] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 20:32:52 2023] DELETE /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] HTTP exception thrown: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Request method failure captured: Apr 13 20:32:52 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 HTTP/1.1 Apr 13 20:32:52 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:32:52 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:32:52 user devstack@n-api.service[61655]: Connection: close Apr 13 20:32:52 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:32:52 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:32:52 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:32:52 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:32:52 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGOmzq0nwiJsCk00XiqmpX0ELkLMYn5tl5KYt34xhUMwtWAy_Rb2wo2L1baLmjq7xTp1JUJpITDivM3g4D2M-lNlY1EeA3Hejtk7OWPIKCdIgZJ9aZBzBhJ6jqRKWYuX9p2DdHywy53J4QMsLD9rRmTXVHnf9NGiVcYViLsNOtOh4WI Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Project-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/405aed9fca044ab39eabe188942230d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/405aed9fca044ab39eabe188942230d2"}]}] Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Tenant-Id: 405aed9fca044ab39eabe188942230d2 Apr 13 20:32:52 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-160294736 Apr 13 20:32:52 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:52 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:32:52 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:32:52 user devstack@n-api.service[61655]: X-User-Id: 36e11efc98604eb7a8d5b95563431e45 Apr 13 20:32:52 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeShelveTestJSON-160294736-project-member Apr 13 20:32:52 user devstack@n-api.service[61655]: method: > Apr 13 20:32:52 user devstack@n-api.service[61655]: exception: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61655]: action_args: {'id': '2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9'} Apr 13 20:32:52 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. Apr 13 20:32:52 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:32:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Returning 404 to user: Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:32:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a270fa96-8590-412c-a05f-6ca71ca06da6 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" status: 404 len: 111 microversion: 2.20 time: 0.033809 Apr 13 20:32:52 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 219/658] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:32:52 2023] GET /compute/v2.1/servers/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 20:32:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Creating event network-vif-unplugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:32:52 user devstack@n-api.service[61654]: DEBUG nova.compute.api [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61654) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:32:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075018 Apr 13 20:32:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 219/659] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:32:54 user devstack@n-api.service[61653]: DEBUG nova.compute.api [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61653) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:32:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046140 Apr 13 20:32:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 222/660] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:32:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:32:55 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:32:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ff37d799-a36a-405e-a718-fbd18ff3067a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 200 len: 1551 microversion: 2.1 time: 0.240200 Apr 13 20:32:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 220/661] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:32:55 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 1551 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:32:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-bd996d72-36d3-4757-b5ce-7c93b7d53aa4 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833db0f70>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-bd996d72-36d3-4757-b5ce-7c93b7d53aa4 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/93732cf7-3a85-4c9b-8900-aaed632b4c0a" status: 200 len: 351 microversion: 2.1 time: 0.053363 Apr 13 20:32:56 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 220/662] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:32:56 2023] GET /compute/v2.1/os-volumes/93732cf7-3a85-4c9b-8900-aaed632b4c0a => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1d6bedd8-c0e9-4e20-b85b-7f5c896d59f2 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Action: 'create', calling method: .version_select at 0x7f7833e21750>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-426797372"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1d6bedd8-c0e9-4e20-b85b-7f5c896d59f2 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.511377 Apr 13 20:32:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 223/663] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 13 20:32:56 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 515 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 20:32:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6c72d164-402c-433b-85c0-e2e3920c09d2 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d8fd90>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6c72d164-402c-433b-85c0-e2e3920c09d2 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 200 len: 344 microversion: 2.1 time: 0.054814 Apr 13 20:32:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 221/664] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:32:57 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:32:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-98813364-ac6c-4957-9c9f-6f74b9222a93 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833db09d0>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-98813364-ac6c-4957-9c9f-6f74b9222a93 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 200 len: 344 microversion: 2.1 time: 0.056666 Apr 13 20:32:58 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 221/665] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:32:58 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:58 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bf373b73-a612-440b-9bba-1511604bd1b9 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833d893f0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:59 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-bf373b73-a612-440b-9bba-1511604bd1b9 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f8714b92-c6ab-4d1a-a625-3a58cb38045d" status: 200 len: 351 microversion: 2.1 time: 0.050760 Apr 13 20:32:59 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 224/666] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:32:58 2023] GET /compute/v2.1/os-volumes/f8714b92-c6ab-4d1a-a625-3a58cb38045d => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:59 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6ac57360-52ab-48ca-87af-8953ad46dc40 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833c73400>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:59 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:32:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6ac57360-52ab-48ca-87af-8953ad46dc40 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 200 len: 345 microversion: 2.1 time: 0.074654 Apr 13 20:32:59 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 222/667] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:32:59 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:59 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-68cea51d-356a-4534-a7c6-144d500aedc8 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Action: 'create', calling method: .version_select at 0x7f7833db2c20>, body: {"snapshot": {"volume_id": "931cf704-8a9d-424e-8831-3af8da6890c4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1192568272"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:32:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-68cea51d-356a-4534-a7c6-144d500aedc8 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.162910 Apr 13 20:32:59 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 222/668] 10.0.0.210 () {64 vars in 1239 bytes} [Thu Apr 13 20:32:59 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:59 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-40c11cbb-912f-4f4f-bc63-b1314b8a6e83 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d89e10>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:59 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-40c11cbb-912f-4f4f-bc63-b1314b8a6e83 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 287 microversion: 2.1 time: 0.043802 Apr 13 20:32:59 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 225/669] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:32:59 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:59 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a9eeb8f6-fd0b-44af-baab-d0e0abb57072 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d8fd90>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a9eeb8f6-fd0b-44af-baab-d0e0abb57072 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032357 Apr 13 20:32:59 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 223/670] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 20:32:59 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:32:59 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9d66394d-0e77-47eb-a937-34eb05664097 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f78381cdf30>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:32:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9d66394d-0e77-47eb-a937-34eb05664097 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 287 microversion: 2.1 time: 0.034984 Apr 13 20:32:59 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 223/671] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:32:59 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:00 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-08893d05-8ee5-46ff-b10e-e072be622419 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833d8ae60>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:00 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-08893d05-8ee5-46ff-b10e-e072be622419 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/559b49c6-ff2e-406b-9b97-86d4ff3c6278" status: 200 len: 350 microversion: 2.1 time: 0.056317 Apr 13 20:33:00 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 226/672] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:33:00 2023] GET /compute/v2.1/os-volumes/559b49c6-ff2e-406b-9b97-86d4ff3c6278 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7ae1e290-1a52-4819-9df2-f01c7774957e tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833b7c700>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:00 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7ae1e290-1a52-4819-9df2-f01c7774957e tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087899 Apr 13 20:33:00 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 224/673] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 20:33:00 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:00 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-c8851ac4-b320-4e3c-9b0f-4161dcf0aaa9 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833d104c0>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:00 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d48b17cc-8986-43c8-828d-552156689185 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d8b010>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:00 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d48b17cc-8986-43c8-828d-552156689185 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 287 microversion: 2.1 time: 0.042254 Apr 13 20:33:00 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 227/674] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:33:00 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:00 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-c8851ac4-b320-4e3c-9b0f-4161dcf0aaa9 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097025 Apr 13 20:33:00 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 224/675] 10.0.0.210 () {62 vars in 1226 bytes} [Thu Apr 13 20:33:00 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-45f3750c-1803-4fcc-afbe-c567953b1ea3 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833c71f30>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:00 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-45f3750c-1803-4fcc-afbe-c567953b1ea3 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083050 Apr 13 20:33:00 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 225/676] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 20:33:00 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:00 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c29c742d-9f84-4ec4-94e8-5bfa9f5d542e tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833d88310>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:00 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c29c742d-9f84-4ec4-94e8-5bfa9f5d542e tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.110980 Apr 13 20:33:00 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 228/677] 10.0.0.210 () {62 vars in 1244 bytes} [Thu Apr 13 20:33:00 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:00 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3c07edf6-148f-4646-b0b7-eeb1ba54fcdb tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833febc70>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-3c07edf6-148f-4646-b0b7-eeb1ba54fcdb tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.159713 Apr 13 20:33:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 225/678] 10.0.0.210 () {62 vars in 1247 bytes} [Thu Apr 13 20:33:00 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:01 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-eba14704-c527-4961-9cb6-1964e220bde2 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833ecfb50>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-eba14704-c527-4961-9cb6-1964e220bde2 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093468 Apr 13 20:33:01 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 226/679] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 20:33:01 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:01 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2b0fba94-8b6f-44b4-ab52-0869685748f5 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833d88160>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:01 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2b0fba94-8b6f-44b4-ab52-0869685748f5 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093245 Apr 13 20:33:01 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 229/680] 10.0.0.210 () {62 vars in 1265 bytes} [Thu Apr 13 20:33:01 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-4c40f6dc-5221-4494-ad1d-2550801c1ae5 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] Calling method '.version_select at 0x7f7833d11000>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-4c40f6dc-5221-4494-ad1d-2550801c1ae5 tempest-VolumesTestJSON-942367267 tempest-VolumesTestJSON-942367267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.106348 Apr 13 20:33:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 226/681] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 20:33:01 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:01 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c21a1b9e-2b9b-4d76-a0bf-8863e8307e8d tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d8fd90>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c21a1b9e-2b9b-4d76-a0bf-8863e8307e8d tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 287 microversion: 2.1 time: 0.045824 Apr 13 20:33:01 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 227/682] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:33:01 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:02 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-caca67c2-f206-4cb9-8eaf-0ba491c0c2cc tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d89bd0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:03 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-caca67c2-f206-4cb9-8eaf-0ba491c0c2cc tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 288 microversion: 2.1 time: 0.325128 Apr 13 20:33:03 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 230/683] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:33:02 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 288 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:03 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:03 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:03 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7428352a-0cd5-4190-93f6-cab784e1e910 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833db31c0>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:03 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7428352a-0cd5-4190-93f6-cab784e1e910 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 202 len: 0 microversion: 2.1 time: 0.074421 Apr 13 20:33:03 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 227/684] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 20:33:03 2023] DELETE /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:33:03 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-47ae21ae-271c-40b7-8701-c2101bf625e1 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833c71090>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-47ae21ae-271c-40b7-8701-c2101bf625e1 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 287 microversion: 2.1 time: 0.041962 Apr 13 20:33:03 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 228/685] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:33:03 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a31d8a96-8b67-4cfb-a67d-cb5e377675c2 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d8bd90>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a31d8a96-8b67-4cfb-a67d-cb5e377675c2 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 287 microversion: 2.1 time: 0.039672 Apr 13 20:33:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 231/686] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:33:04 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:05 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-c7fb69d9-983d-49b9-bb65-4bcf9d7f1bc7 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d11360>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-c7fb69d9-983d-49b9-bb65-4bcf9d7f1bc7 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 287 microversion: 2.1 time: 0.049077 Apr 13 20:33:05 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 228/687] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:33:05 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:33:05 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=23 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:05 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:05 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:05 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:33:05 user devstack@n-api.service[61655]: DEBUG nova.compute.api [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61655) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:33:05 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070549 Apr 13 20:33:05 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 229/688] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=15 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0c13d5d1-2b5b-46da-bdf7-b850e706e183 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073585 Apr 13 20:33:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 232/689] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:33:06 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:06 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7a58099d-9c32-46e9-978f-f442ecb65d4a tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833ece440>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] HTTP exception thrown: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce is not attached to volume 80e647b5-ac5e-491b-acfc-32f350f2cc4a Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Request method failure captured: Apr 13 20:33:06 user devstack@n-api.service[61654]: request: DELETE /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments/80e647b5-ac5e-491b-acfc-32f350f2cc4a HTTP/1.1 Apr 13 20:33:06 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:33:06 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:33:06 user devstack@n-api.service[61654]: Connection: close Apr 13 20:33:06 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:33:06 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:33:06 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:33:06 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:33:06 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGXT8P3Pc1LLQPf6QUkD3NTw-0n8CpWOFCKgqUHRWdIcJ3HztGH1wBeB8VCvpnc2zEiSJuhzHP46oDmIsVzxshPT6KP8pYmjHP3ZcmYanmUO5lOrt1VtHKFRpCX1Ry79NBrZydCWWrPdQ_LsxMIRR4pmIBgcBJnQghdsZPkTyycbcxI Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Project-Id: 41f1e999778042e2a606a2ae4072bc83 Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41f1e999778042e2a606a2ae4072bc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41f1e999778042e2a606a2ae4072bc83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41f1e999778042e2a606a2ae4072bc83"}]}] Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Tenant: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Tenant-Id: 41f1e999778042e2a606a2ae4072bc83 Apr 13 20:33:06 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:33:06 user devstack@n-api.service[61654]: X-User: tempest-TestMinimumBasicScenario-1286218256-project-member Apr 13 20:33:06 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:33:06 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:33:06 user devstack@n-api.service[61654]: X-User-Id: 519afe2b763347ea889f7de8773d7de0 Apr 13 20:33:06 user devstack@n-api.service[61654]: X-User-Name: tempest-TestMinimumBasicScenario-1286218256-project-member Apr 13 20:33:06 user devstack@n-api.service[61654]: method: > Apr 13 20:33:06 user devstack@n-api.service[61654]: exception: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce is not attached to volume 80e647b5-ac5e-491b-acfc-32f350f2cc4a Apr 13 20:33:06 user devstack@n-api.service[61654]: action_args: {'server_id': '5be87410-64d6-43f1-b8f2-70ace93f90ce', 'id': '80e647b5-ac5e-491b-acfc-32f350f2cc4a'} Apr 13 20:33:06 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 80e647b5-ac5e-491b-acfc-32f350f2cc4a. Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce is not attached to volume 80e647b5-ac5e-491b-acfc-32f350f2cc4a Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce is not attached to volume 80e647b5-ac5e-491b-acfc-32f350f2cc4a Apr 13 20:33:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Returning 404 to user: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce is not attached to volume 80e647b5-ac5e-491b-acfc-32f350f2cc4a {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:33:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-376d41dd-b394-4dcc-9901-9962ab1470ac tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments/80e647b5-ac5e-491b-acfc-32f350f2cc4a" status: 404 len: 154 microversion: 2.1 time: 0.179934 Apr 13 20:33:06 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 229/690] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:33:06 2023] DELETE /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce/os-volume_attachments/80e647b5-ac5e-491b-acfc-32f350f2cc4a => generated 154 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:33:06 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7a58099d-9c32-46e9-978f-f442ecb65d4a tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 200 len: 287 microversion: 2.1 time: 0.044702 Apr 13 20:33:06 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 230/691] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:33:06 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-f5212dce-b5c1-42a1-8139-dc059ada47fb tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d88af0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:07 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-f5212dce-b5c1-42a1-8139-dc059ada47fb tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] HTTP exception thrown: Snapshot 70c82deb-0f90-48f9-980d-7763400254c0 could not be found. Apr 13 20:33:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-f5212dce-b5c1-42a1-8139-dc059ada47fb tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Request method failure captured: Apr 13 20:33:07 user devstack@n-api.service[61653]: request: GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 HTTP/1.1 Apr 13 20:33:07 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:33:07 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:33:07 user devstack@n-api.service[61653]: Connection: close Apr 13 20:33:07 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:33:07 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:33:07 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:33:07 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:33:07 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGb4OcUK8RmeAI1TsQ1HRq9EJygPneob2TdrvH3jhqyAwXbWWHkQVNQ2tejI4D3tt7TjwxLD6B6_5SKGZD0cxXTFU90i2970xRAAXFCnRz1owCbKre12pjCVvNwphOKDh4ap09i9OTJrq_5dLcYtYXfSmm5bGcSNiFxN8vofsZHKqIM Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Project-Id: c520a64a378543ba92db6b58ea08fb30 Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c520a64a378543ba92db6b58ea08fb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c520a64a378543ba92db6b58ea08fb30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c520a64a378543ba92db6b58ea08fb30"}]}] Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Tenant: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Tenant-Id: c520a64a378543ba92db6b58ea08fb30 Apr 13 20:33:07 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:07 user devstack@n-api.service[61653]: X-User: tempest-VolumesSnapshotsTestJSON-658071002-project-member Apr 13 20:33:07 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:33:07 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:33:07 user devstack@n-api.service[61653]: X-User-Id: df4f5285f1eb43fbb09874fd2273a72e Apr 13 20:33:07 user devstack@n-api.service[61653]: X-User-Name: tempest-VolumesSnapshotsTestJSON-658071002-project-member Apr 13 20:33:07 user devstack@n-api.service[61653]: method: Apr 13 20:33:07 user devstack@n-api.service[61653]: exception: Snapshot 70c82deb-0f90-48f9-980d-7763400254c0 could not be found. Apr 13 20:33:07 user devstack@n-api.service[61653]: action_args: {'id': '70c82deb-0f90-48f9-980d-7763400254c0'} Apr 13 20:33:07 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 70c82deb-0f90-48f9-980d-7763400254c0 could not be found. (HTTP 404) (Request-ID: req-63130b9a-2683-4a56-88ec-a48c75e90082) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 70c82deb-0f90-48f9-980d-7763400254c0 could not be found. Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 70c82deb-0f90-48f9-980d-7763400254c0 could not be found. Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 70c82deb-0f90-48f9-980d-7763400254c0 could not be found. Apr 13 20:33:07 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-f5212dce-b5c1-42a1-8139-dc059ada47fb tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Returning 404 to user: Snapshot 70c82deb-0f90-48f9-980d-7763400254c0 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:33:07 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-f5212dce-b5c1-42a1-8139-dc059ada47fb tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0" status: 404 len: 111 microversion: 2.1 time: 0.039338 Apr 13 20:33:07 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 233/692] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:33:07 2023] GET /compute/v2.1/os-snapshots/70c82deb-0f90-48f9-980d-7763400254c0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:33:07 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9aca7060-6e7c-4a48-8a97-10ba56b10a8d tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833db32e0>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9aca7060-6e7c-4a48-8a97-10ba56b10a8d tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 202 len: 0 microversion: 2.1 time: 0.078588 Apr 13 20:33:07 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 230/693] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:33:07 2023] DELETE /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:33:07 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-064abf80-f195-404a-8315-769e3008b722 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833b7e200>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:07 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-064abf80-f195-404a-8315-769e3008b722 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 200 len: 344 microversion: 2.1 time: 0.071055 Apr 13 20:33:07 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 231/694] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:33:07 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:33:08 user devstack@n-api.service[61653]: DEBUG nova.compute.api [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61653) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:33:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045840 Apr 13 20:33:08 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 234/695] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:08 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-f697d620-54f7-433c-ba24-00a34953399a tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d11000>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:08 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-f697d620-54f7-433c-ba24-00a34953399a tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 200 len: 344 microversion: 2.1 time: 0.058508 Apr 13 20:33:08 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 231/696] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:33:08 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-5720dfb3-d54e-461e-9d4e-1f7ac994d1c3 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833b7e170>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-5720dfb3-d54e-461e-9d4e-1f7ac994d1c3 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 200 len: 344 microversion: 2.1 time: 0.071863 Apr 13 20:33:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 232/697] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:33:09 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:09 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:33:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 204 len: 0 microversion: 2.1 time: 0.169058 Apr 13 20:33:10 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 235/698] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:33:09 2023] DELETE /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:10 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:33:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-3531c845-7f37-40e9-8391-3f597085df32 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 200 len: 1544 microversion: 2.1 time: 0.255913 Apr 13 20:33:10 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 232/699] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:33:10 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-unplugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] Creating event network-vif-unplugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:33:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058419 Apr 13 20:33:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 233/700] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2cd067bf-87c7-4574-b88d-086c1c02d7f5 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d8b520>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2cd067bf-87c7-4574-b88d-086c1c02d7f5 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 200 len: 344 microversion: 2.1 time: 0.082075 Apr 13 20:33:10 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 236/701] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:33:10 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:11 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-5679a811-34a8-4923-b14e-88bd3d678547 req-d9b5985f-c018-4c23-a7df-681eb38d914d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-deleted", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5679a811-34a8-4923-b14e-88bd3d678547 req-d9b5985f-c018-4c23-a7df-681eb38d914d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5679a811-34a8-4923-b14e-88bd3d678547 req-d9b5985f-c018-4c23-a7df-681eb38d914d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5679a811-34a8-4923-b14e-88bd3d678547 req-d9b5985f-c018-4c23-a7df-681eb38d914d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-5679a811-34a8-4923-b14e-88bd3d678547 req-d9b5985f-c018-4c23-a7df-681eb38d914d service nova] Creating event network-vif-deleted:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:33:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-5679a811-34a8-4923-b14e-88bd3d678547 req-d9b5985f-c018-4c23-a7df-681eb38d914d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037130 Apr 13 20:33:11 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 233/702] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:33:11 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-263b3ee8-3f14-4a9c-9297-cde98a143ba5 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833c73c70>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:11 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-263b3ee8-3f14-4a9c-9297-cde98a143ba5 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 200 len: 344 microversion: 2.1 time: 0.094541 Apr 13 20:33:11 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 234/703] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:33:11 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}, {"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}, {"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}, {"server_uuid": "5be87410-64d6-43f1-b8f2-70ace93f90ce", "name": "network-vif-plugged", "status": "completed", "tag": "616b4969-2bbc-47cf-ac86-236d2fb36468"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:33:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:33:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:33:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Creating event network-vif-plugged:616b4969-2bbc-47cf-ac86-236d2fb36468 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce on user Apr 13 20:33:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.051732 Apr 13 20:33:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 237/704] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:12 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:12 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-881a8df3-888a-4dfd-a54d-404b4a602f17 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833db3010>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:13 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-881a8df3-888a-4dfd-a54d-404b4a602f17 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] HTTP exception thrown: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-881a8df3-888a-4dfd-a54d-404b4a602f17 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Request method failure captured: Apr 13 20:33:13 user devstack@n-api.service[61654]: request: GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 HTTP/1.1 Apr 13 20:33:13 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:33:13 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:33:13 user devstack@n-api.service[61654]: Connection: close Apr 13 20:33:13 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:33:13 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:33:13 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:33:13 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:33:13 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGb4OcUK8RmeAI1TsQ1HRq9EJygPneob2TdrvH3jhqyAwXbWWHkQVNQ2tejI4D3tt7TjwxLD6B6_5SKGZD0cxXTFU90i2970xRAAXFCnRz1owCbKre12pjCVvNwphOKDh4ap09i9OTJrq_5dLcYtYXfSmm5bGcSNiFxN8vofsZHKqIM Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Project-Id: c520a64a378543ba92db6b58ea08fb30 Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c520a64a378543ba92db6b58ea08fb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c520a64a378543ba92db6b58ea08fb30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c520a64a378543ba92db6b58ea08fb30"}]}] Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Tenant-Id: c520a64a378543ba92db6b58ea08fb30 Apr 13 20:33:13 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61654]: X-User: tempest-VolumesSnapshotsTestJSON-658071002-project-member Apr 13 20:33:13 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:33:13 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:33:13 user devstack@n-api.service[61654]: X-User-Id: df4f5285f1eb43fbb09874fd2273a72e Apr 13 20:33:13 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesSnapshotsTestJSON-658071002-project-member Apr 13 20:33:13 user devstack@n-api.service[61654]: method: Apr 13 20:33:13 user devstack@n-api.service[61654]: exception: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61654]: action_args: {'id': '931cf704-8a9d-424e-8831-3af8da6890c4'} Apr 13 20:33:13 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. (HTTP 404) (Request-ID: req-19f8152f-794c-4ab5-a9c5-626989648b86) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-881a8df3-888a-4dfd-a54d-404b4a602f17 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Returning 404 to user: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:33:13 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-881a8df3-888a-4dfd-a54d-404b4a602f17 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 404 len: 109 microversion: 2.1 time: 0.443900 Apr 13 20:33:13 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:33:12 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 109 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:33:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-905c8701-e1a6-4336-ac2f-740be9579a53 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833c73a30>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-905c8701-e1a6-4336-ac2f-740be9579a53 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] HTTP exception thrown: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-905c8701-e1a6-4336-ac2f-740be9579a53 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Request method failure captured: Apr 13 20:33:13 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 HTTP/1.1 Apr 13 20:33:13 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:33:13 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:33:13 user devstack@n-api.service[61655]: Connection: close Apr 13 20:33:13 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:33:13 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:33:13 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:33:13 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:33:13 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGb4OcUK8RmeAI1TsQ1HRq9EJygPneob2TdrvH3jhqyAwXbWWHkQVNQ2tejI4D3tt7TjwxLD6B6_5SKGZD0cxXTFU90i2970xRAAXFCnRz1owCbKre12pjCVvNwphOKDh4ap09i9OTJrq_5dLcYtYXfSmm5bGcSNiFxN8vofsZHKqIM Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Project-Id: c520a64a378543ba92db6b58ea08fb30 Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c520a64a378543ba92db6b58ea08fb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c520a64a378543ba92db6b58ea08fb30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c520a64a378543ba92db6b58ea08fb30"}]}] Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Tenant: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Tenant-Id: c520a64a378543ba92db6b58ea08fb30 Apr 13 20:33:13 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61655]: X-User: tempest-VolumesSnapshotsTestJSON-658071002-project-member Apr 13 20:33:13 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:33:13 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:33:13 user devstack@n-api.service[61655]: X-User-Id: df4f5285f1eb43fbb09874fd2273a72e Apr 13 20:33:13 user devstack@n-api.service[61655]: X-User-Name: tempest-VolumesSnapshotsTestJSON-658071002-project-member Apr 13 20:33:13 user devstack@n-api.service[61655]: method: Apr 13 20:33:13 user devstack@n-api.service[61655]: exception: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61655]: action_args: {'id': '931cf704-8a9d-424e-8831-3af8da6890c4'} Apr 13 20:33:13 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. (HTTP 404) (Request-ID: req-bf4ed9c9-72a6-43b5-8a27-5971ce60183e) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-905c8701-e1a6-4336-ac2f-740be9579a53 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Returning 404 to user: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:33:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-905c8701-e1a6-4336-ac2f-740be9579a53 tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 404 len: 109 microversion: 2.1 time: 0.041764 Apr 13 20:33:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 235/706] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:33:13 2023] DELETE /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:33:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3527052c-8ff3-4e4f-b236-03dc1097928f tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Calling method '.version_select at 0x7f7833d89b40>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-3527052c-8ff3-4e4f-b236-03dc1097928f tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] HTTP exception thrown: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3527052c-8ff3-4e4f-b236-03dc1097928f tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Request method failure captured: Apr 13 20:33:13 user devstack@n-api.service[61653]: request: GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 HTTP/1.1 Apr 13 20:33:13 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:33:13 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:33:13 user devstack@n-api.service[61653]: Connection: close Apr 13 20:33:13 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:33:13 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:33:13 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:33:13 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:33:13 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGb4OcUK8RmeAI1TsQ1HRq9EJygPneob2TdrvH3jhqyAwXbWWHkQVNQ2tejI4D3tt7TjwxLD6B6_5SKGZD0cxXTFU90i2970xRAAXFCnRz1owCbKre12pjCVvNwphOKDh4ap09i9OTJrq_5dLcYtYXfSmm5bGcSNiFxN8vofsZHKqIM Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Project-Id: c520a64a378543ba92db6b58ea08fb30 Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c520a64a378543ba92db6b58ea08fb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c520a64a378543ba92db6b58ea08fb30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c520a64a378543ba92db6b58ea08fb30"}]}] Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Tenant: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Tenant-Id: c520a64a378543ba92db6b58ea08fb30 Apr 13 20:33:13 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-658071002 Apr 13 20:33:13 user devstack@n-api.service[61653]: X-User: tempest-VolumesSnapshotsTestJSON-658071002-project-member Apr 13 20:33:13 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:33:13 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:33:13 user devstack@n-api.service[61653]: X-User-Id: df4f5285f1eb43fbb09874fd2273a72e Apr 13 20:33:13 user devstack@n-api.service[61653]: X-User-Name: tempest-VolumesSnapshotsTestJSON-658071002-project-member Apr 13 20:33:13 user devstack@n-api.service[61653]: method: Apr 13 20:33:13 user devstack@n-api.service[61653]: exception: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61653]: action_args: {'id': '931cf704-8a9d-424e-8831-3af8da6890c4'} Apr 13 20:33:13 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. (HTTP 404) (Request-ID: req-bdf146cc-6b4a-4c34-be2c-dc0266ee8115) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. Apr 13 20:33:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:33:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3527052c-8ff3-4e4f-b236-03dc1097928f tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] Returning 404 to user: Volume 931cf704-8a9d-424e-8831-3af8da6890c4 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:33:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3527052c-8ff3-4e4f-b236-03dc1097928f tempest-VolumesSnapshotsTestJSON-658071002 tempest-VolumesSnapshotsTestJSON-658071002-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4" status: 404 len: 109 microversion: 2.1 time: 0.036916 Apr 13 20:33:13 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 238/707] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 20:33:13 2023] GET /compute/v2.1/os-volumes/931cf704-8a9d-424e-8831-3af8da6890c4 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:33:17 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:17 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:18 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:33:18 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9f987b06-6492-45e7-b8ec-ac3fd9d9ac15 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77" status: 200 len: 1535 microversion: 2.1 time: 0.447789 Apr 13 20:33:18 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 235/708] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:33:17 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 => generated 1535 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-517346965", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "72b4976e-72c4-4595-8a8c-89a79ac21d49"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] validate_networks() for [('72b4976e-72c4-4595-8a8c-89a79ac21d49', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Getting quotas for project d550373054224fcbbb7300f512ad0345. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Getting quotas for user 3993eb2be0d94cdbb16fd233999fc5c2 and project d550373054224fcbbb7300f512ad0345. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:33:19 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:33:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.535546 Apr 13 20:33:19 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 236/709] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:33:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:33:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a23e1f4f-c18b-45e9-a1aa-24cfce83f0a4 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:19 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a23e1f4f-c18b-45e9-a1aa-24cfce83f0a4 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:19 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-a23e1f4f-c18b-45e9-a1aa-24cfce83f0a4 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3993eb2be0d94cdbb16fd233999fc5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd550373054224fcbbb7300f512ad0345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:33:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a23e1f4f-c18b-45e9-a1aa-24cfce83f0a4 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" status: 200 len: 1207 microversion: 2.1 time: 0.080890 Apr 13 20:33:19 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 239/710] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:33:19 2023] GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 => generated 1207 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33", "tag": "b0bb456d-5327-4938-8949-7c965ee9221d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] Creating event network-changed:b0bb456d-5327-4938-8949-7c965ee9221d for instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 on user Apr 13 20:33:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048364 Apr 13 20:33:22 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 236/711] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:24 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33", "name": "network-vif-plugged", "status": "completed", "tag": "b0bb456d-5327-4938-8949-7c965ee9221d"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:24 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] Creating event network-vif-plugged:b0bb456d-5327-4938-8949-7c965ee9221d for instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 on user Apr 13 20:33:24 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Apr 13 20:33:24 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 237/712] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:26 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33", "name": "network-vif-plugged", "status": "completed", "tag": "b0bb456d-5327-4938-8949-7c965ee9221d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:26 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] Creating event network-vif-plugged:b0bb456d-5327-4938-8949-7c965ee9221d for instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 on user Apr 13 20:33:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044313 Apr 13 20:33:26 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 240/713] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=10 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=22 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-f4503a5e-c915-4c10-8860-d162c8bcb553 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081778 Apr 13 20:33:33 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 237/714] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:33:32 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:33 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:33:33 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5" status: 204 len: 0 microversion: 2.1 time: 0.339104 Apr 13 20:33:33 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 238/715] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:33:33 2023] DELETE /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:33 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:33:33 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-33df68a2-f849-403a-86a9-cf22be8150d9 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5" status: 200 len: 1667 microversion: 2.1 time: 0.305658 Apr 13 20:33:33 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 241/716] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:33:33 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 => generated 1667 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:33 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8acd3c03-8835-4b69-aabd-7a5a34b910d5", "name": "network-vif-unplugged", "status": "completed", "tag": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] Creating event network-vif-unplugged:e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 on user Apr 13 20:33:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032068 Apr 13 20:33:33 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 238/717] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:35 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8acd3c03-8835-4b69-aabd-7a5a34b910d5", "name": "network-vif-deleted", "tag": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:35 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] Creating event network-vif-deleted:e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 on user Apr 13 20:33:35 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 Apr 13 20:33:35 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 239/718] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:35 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8acd3c03-8835-4b69-aabd-7a5a34b910d5", "name": "network-vif-plugged", "status": "completed", "tag": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:35 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] Creating event network-vif-plugged:e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 on user Apr 13 20:33:35 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 Apr 13 20:33:35 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 242/719] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:40 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:33:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-725d62c6-6649-4287-8b00-ea4db8bbb25d tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1729 microversion: 2.1 time: 0.194024 Apr 13 20:33:40 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 239/720] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:33:40 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:45 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:33:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8b8fb22e-d49b-4195-a314-869d5b60a168 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590" status: 200 len: 1392 microversion: 2.1 time: 0.160327 Apr 13 20:33:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 240/721] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:33:45 2023] GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-678969581"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:45 user devstack@n-api.service[61653]: INFO nova.compute.api [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Attempting to quiesce instance before volume snapshot. Apr 13 20:33:45 user devstack@n-api.service[61653]: INFO nova.compute.api [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 13 20:33:45 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Creating snapshot from volume 2b663208-c712-444c-9d05-1b84e247c6ac. {{(pid=61653) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 13 20:33:48 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-f0563765-59a3-437c-b914-c6f0e4010ea3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590/action" status: 202 len: 0 microversion: 2.1 time: 2.505155 Apr 13 20:33:48 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 243/722] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:33:45 2023] POST /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590/action => generated 0 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 20:33:48 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1920913930", "imageRef": "e2252929-c60d-4172-92bf-b4700b193055", "flavorRef": "42", "networks": [{"uuid": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0"}]}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:48 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] validate_networks() for [('e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for user 7e478a11b57b4ee385e33c4709adf04b and project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:33:49 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f15bc8ef-ea4c-47d6-b6f3-8b6068028b6f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:33:49 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.024394 Apr 13 20:33:49 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 240/723] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:33:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:33:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8a4d7de9-00b8-41cc-adeb-053d65a8e7bd tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:49 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8a4d7de9-00b8-41cc-adeb-053d65a8e7bd tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:49 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-8a4d7de9-00b8-41cc-adeb-053d65a8e7bd tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:33:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8a4d7de9-00b8-41cc-adeb-053d65a8e7bd tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1" status: 200 len: 1224 microversion: 2.1 time: 0.092111 Apr 13 20:33:49 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 241/724] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:33:49 2023] GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:33:51 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5940c278-df77-472e-a32f-e431c5f4b1d1", "tag": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:51 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] Creating event network-changed:c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance 5940c278-df77-472e-a32f-e431c5f4b1d1 on user Apr 13 20:33:51 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039790 Apr 13 20:33:51 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 244/725] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:33:55 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e8b0fb32-c471-45d7-aa15-2b0fcee217fb tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.093363 Apr 13 20:33:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 241/726] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:33:55 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-interface => generated 282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:56 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:56 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] Creating event network-changed:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:33:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034425 Apr 13 20:33:56 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 242/727] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:33:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea7203e7-62fc-4103-9662-be40fbd06e1e"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:33:56 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:33:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328444 Apr 13 20:33:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 245/728] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:33:56 2023] POST /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:00 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] HTTP exception thrown: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce could not be found. Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Request method failure captured: Apr 13 20:34:00 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce HTTP/1.1 Apr 13 20:34:00 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:34:00 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:34:00 user devstack@n-api.service[61654]: Connection: close Apr 13 20:34:00 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:34:00 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:34:00 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:34:00 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:34:00 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGXT8P3Pc1LLQPf6QUkD3NTw-0n8CpWOFCKgqUHRWdIcJ3HztGH1wBeB8VCvpnc2zEiSJuhzHP46oDmIsVzxshPT6KP8pYmjHP3ZcmYanmUO5lOrt1VtHKFRpCX1Ry79NBrZydCWWrPdQ_LsxMIRR4pmIBgcBJnQghdsZPkTyycbcxI Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Project-Id: 41f1e999778042e2a606a2ae4072bc83 Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41f1e999778042e2a606a2ae4072bc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41f1e999778042e2a606a2ae4072bc83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41f1e999778042e2a606a2ae4072bc83"}]}] Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Tenant: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Tenant-Id: 41f1e999778042e2a606a2ae4072bc83 Apr 13 20:34:00 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:34:00 user devstack@n-api.service[61654]: X-User: tempest-TestMinimumBasicScenario-1286218256-project-member Apr 13 20:34:00 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:34:00 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:34:00 user devstack@n-api.service[61654]: X-User-Id: 519afe2b763347ea889f7de8773d7de0 Apr 13 20:34:00 user devstack@n-api.service[61654]: X-User-Name: tempest-TestMinimumBasicScenario-1286218256-project-member Apr 13 20:34:00 user devstack@n-api.service[61654]: method: > Apr 13 20:34:00 user devstack@n-api.service[61654]: exception: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce could not be found. Apr 13 20:34:00 user devstack@n-api.service[61654]: action_args: {'id': '5be87410-64d6-43f1-b8f2-70ace93f90ce'} Apr 13 20:34:00 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce could not be found. Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce could not be found. Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce could not be found. Apr 13 20:34:00 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:00 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Returning 404 to user: Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:34:00 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b021ae13-4664-4046-bdea-65c1fdfc10b5 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce" status: 404 len: 111 microversion: 2.1 time: 0.036206 Apr 13 20:34:00 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 242/729] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:00 2023] GET /compute/v2.1/servers/5be87410-64d6-43f1-b8f2-70ace93f90ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:34:00 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6fce0a78-376a-4465-9a6f-7b9ae42c411d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '.version_select at 0x7f7833b7f370>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:00 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6fce0a78-376a-4465-9a6f-7b9ae42c411d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1162257408" status: 202 len: 0 microversion: 2.1 time: 0.036483 Apr 13 20:34:00 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 243/730] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 20:34:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1162257408 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:34:02 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-282b1179-f486-4bcb-80ea-a5897fb992e1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'create', calling method: .version_select at 0x7f7833d8b400>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1669926210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2S5vFB89cjhQNHK5tZERx5gotmSUz6nfYAxb1HGI7pIUEexdW1x3UmogJ+OT5avBe+NR2lh0fefQ4RhxvlylngtZR/3ODNtw6vOAC/JGaj6FVzVw6aEo4e8xfRqWS5uA=="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:02 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-282b1179-f486-4bcb-80ea-a5897fb992e1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting quotas for project 41f1e999778042e2a606a2ae4072bc83. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:34:02 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-282b1179-f486-4bcb-80ea-a5897fb992e1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting quotas for user 519afe2b763347ea889f7de8773d7de0 and project 41f1e999778042e2a606a2ae4072bc83. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:34:02 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-282b1179-f486-4bcb-80ea-a5897fb992e1 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061525 Apr 13 20:34:02 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 246/731] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:34:02 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-886625623", "imageRef": "b68e778d-6c7f-4c39-a545-ef4067ed0d6d", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1669926210", "networks": [{"uuid": "01cb6d35-c31b-48c0-8594-46a80ae181d6"}]}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] validate_networks() for [('01cb6d35-c31b-48c0-8594-46a80ae181d6', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=23 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting quotas for project 41f1e999778042e2a606a2ae4072bc83. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting quotas for user 519afe2b763347ea889f7de8773d7de0 and project 41f1e999778042e2a606a2ae4072bc83. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:34:03 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b68e778d-6c7f-4c39-a545-ef4067ed0d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:34:03 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.505620 Apr 13 20:34:03 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 243/732] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:34:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:34:03 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d36d495f-83f5-425a-848c-ddc87e757be6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:03 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d36d495f-83f5-425a-848c-ddc87e757be6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:03 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-d36d495f-83f5-425a-848c-ddc87e757be6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d36d495f-83f5-425a-848c-ddc87e757be6 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1252 microversion: 2.1 time: 0.253191 Apr 13 20:34:03 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 244/733] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:03 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1252 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:34:03 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5940c278-df77-472e-a32f-e431c5f4b1d1", "name": "network-vif-plugged", "status": "completed", "tag": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:03 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] Creating event network-vif-plugged:c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance 5940c278-df77-472e-a32f-e431c5f4b1d1 on user Apr 13 20:34:03 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Apr 13 20:34:03 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 247/734] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:05 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'flavor' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:34:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/action" status: 200 len: 32 microversion: 2.1 time: 0.425159 Apr 13 20:34:05 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 244/735] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:34:05 2023] POST /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/action => generated 32 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:34:05 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:05 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:06 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5940c278-df77-472e-a32f-e431c5f4b1d1", "name": "network-vif-plugged", "status": "completed", "tag": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] Creating event network-vif-plugged:c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance 5940c278-df77-472e-a32f-e431c5f4b1d1 on user Apr 13 20:34:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033424 Apr 13 20:34:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 248/736] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:06 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:06 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-29ec5b86-a18a-4d34-8ace-d08788584372 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 200 len: 1721 microversion: 2.1 time: 0.259709 Apr 13 20:34:06 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 245/737] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:05 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:34:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] Creating event network-changed:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:34:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029912 Apr 13 20:34:06 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 245/738] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:08 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-unplugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}, {"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Creating event network-vif-unplugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:34:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:34:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.101188 Apr 13 20:34:08 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 249/739] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:08 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:09 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:10 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3993eb2be0d94cdbb16fd233999fc5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd550373054224fcbbb7300f512ad0345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-38911dde-ff3e-406b-b63b-02ac04112cab tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" status: 200 len: 1486 microversion: 2.1 time: 0.151936 Apr 13 20:34:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 246/740] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:09 2023] GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 => generated 1486 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:34:10 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-plugged", "status": "completed", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}, {"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-plugged", "status": "completed", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Creating event network-vif-plugged:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:34:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Creating event network-vif-plugged:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:34:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046923 Apr 13 20:34:10 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 246/741] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}, {"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:34:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:34:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036371 Apr 13 20:34:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 250/742] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:18 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:18 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4f550a4d-7956-4792-95d1-ff4375e9c9eb tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.099954 Apr 13 20:34:18 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 247/743] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:34:18 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-interface => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:19 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:19 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:19 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06095354-ac91-443e-8181-dfa44a14ba77", "tag": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] Creating event network-changed:0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance 06095354-ac91-443e-8181-dfa44a14ba77 on user Apr 13 20:34:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035886 Apr 13 20:34:19 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 247/744] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-e9f74aeb-5166-488a-b416-232fe91e5ea8 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/ips" status: 200 len: 104 microversion: 2.1 time: 0.049232 Apr 13 20:34:19 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 251/745] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:34:19 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/ips => generated 104 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:22 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa357970-388f-4b14-b1ca-b792d3a3562a"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:22 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:22 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271660 Apr 13 20:34:22 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 248/746] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:34:22 2023] POST /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:23 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:34:23 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 HTTP/1.1 Apr 13 20:34:23 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:34:23 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:34:23 user devstack@n-api.service[61654]: Connection: close Apr 13 20:34:23 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:34:23 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:34:23 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:34:23 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:34:23 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:34:23 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:34:23 user devstack@n-api.service[61654]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:34:23 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:34:23 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:34:23 user devstack@n-api.service[61654]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:34:23 user devstack@n-api.service[61654]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:34:23 user devstack@n-api.service[61654]: method: > Apr 13 20:34:23 user devstack@n-api.service[61654]: exception: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:34:23 user devstack@n-api.service[61654]: action_args: {'id': '8acd3c03-8835-4b69-aabd-7a5a34b910d5'} Apr 13 20:34:23 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:34:23 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:34:23 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:34:23 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a6b50f9e-d52e-4015-b4b7-9373a2149686 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5" status: 404 len: 111 microversion: 2.1 time: 0.031115 Apr 13 20:34:23 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 248/747] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:23 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:34:23 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ab037d09-2cc5-406e-8a6e-fd3433f30e68 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '.version_select at 0x7f7833dee830>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:23 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-ab037d09-2cc5-406e-8a6e-fd3433f30e68 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867771061" status: 202 len: 0 microversion: 2.1 time: 0.023812 Apr 13 20:34:23 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 252/748] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 20:34:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867771061 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:34:24 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-5b3d01ae-16e7-4487-a315-d44124fdfa76 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: .version_select at 0x7f7833b7e680>, body: {"keypair": {"name": "tempest-keypair-1660813888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLkeyqTPZ9zMzp+K2DjCVHK8Fa3GGyXnf4flHRT96cr2jBUu9eu68fMFegiIQxTphtLwZPA9dzZOUnzKCoaFrpSY4Hb/zRUN5ub6MdFNW63YZDvgRb0mWJ8/YIj66OtXQ=="}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:24 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-5b3d01ae-16e7-4487-a315-d44124fdfa76 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for project 053f656470d94d2a9140f393bad01000. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:34:24 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-5b3d01ae-16e7-4487-a315-d44124fdfa76 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for user 49383d6f0e7141548370d8bc3b96dfd9 and project 053f656470d94d2a9140f393bad01000. Resources: {'key_pairs'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:34:24 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-5b3d01ae-16e7-4487-a315-d44124fdfa76 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042673 Apr 13 20:34:24 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 249/749] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:34:24 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-75809090", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4a18c4c0-217f-4ba3-96d6-c37b108efca9"}], "security_groups": [{"name": "tempest-securitygroup--458439115"}], "key_name": "tempest-keypair-1660813888", "user_data": "}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] validate_networks() for [('4a18c4c0-217f-4ba3-96d6-c37b108efca9', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:27 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for project 053f656470d94d2a9140f393bad01000. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:34:27 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting quotas for user 49383d6f0e7141548370d8bc3b96dfd9 and project 053f656470d94d2a9140f393bad01000. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:34:27 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:34:27 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:34:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.607280 Apr 13 20:34:27 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 249/750] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:34:26 2023] POST /compute/v2.1/servers => generated 399 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:34:27 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4920bab4-7596-400d-8ecf-28e30ede9b40 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:27 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4920bab4-7596-400d-8ecf-28e30ede9b40 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:27 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-4920bab4-7596-400d-8ecf-28e30ede9b40 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:27 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4920bab4-7596-400d-8ecf-28e30ede9b40 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f" status: 200 len: 1234 microversion: 2.1 time: 0.157044 Apr 13 20:34:27 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 253/751] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:27 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f => generated 1234 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:29 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:30 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-239b6d6d-482e-4565-9839-ab4a79f4da69 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051726 Apr 13 20:34:30 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 250/752] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:34:29 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:30 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:30 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-591e132d-727f-4e4d-bc77-357235c0908a tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aa357970-388f-4b14-b1ca-b792d3a3562a" status: 200 len: 194 microversion: 2.1 time: 0.053575 Apr 13 20:34:30 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 250/753] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 20:34:30 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aa357970-388f-4b14-b1ca-b792d3a3562a => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:30 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bdf333a-456b-413b-92d6-87e45474905f", "tag": "343a5e66-81f2-407f-a646-cc52fdd762c9"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] Creating event network-changed:343a5e66-81f2-407f-a646-cc52fdd762c9 for instance 0bdf333a-456b-413b-92d6-87e45474905f on user Apr 13 20:34:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113808 Apr 13 20:34:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 254/754] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:32 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaf2141e-9057-4904-acfd-5dad001b1254"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:32 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:32 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdf333a-456b-413b-92d6-87e45474905f", "name": "network-vif-plugged", "status": "completed", "tag": "343a5e66-81f2-407f-a646-cc52fdd762c9"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] Creating event network-vif-plugged:343a5e66-81f2-407f-a646-cc52fdd762c9 for instance 0bdf333a-456b-413b-92d6-87e45474905f on user Apr 13 20:34:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037607 Apr 13 20:34:32 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 251/755] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:33 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "POST /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568597 Apr 13 20:34:33 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 251/756] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:34:32 2023] POST /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdf333a-456b-413b-92d6-87e45474905f", "name": "network-vif-plugged", "status": "completed", "tag": "343a5e66-81f2-407f-a646-cc52fdd762c9"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] Creating event network-vif-plugged:343a5e66-81f2-407f-a646-cc52fdd762c9 for instance 0bdf333a-456b-413b-92d6-87e45474905f on user Apr 13 20:34:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035513 Apr 13 20:34:34 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 255/757] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:39 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6bd1fa60-8327-4afc-9bac-cb30387663ed tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1" status: 200 len: 1551 microversion: 2.1 time: 0.164116 Apr 13 20:34:39 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 252/758] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:39 2023] GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/action" status: 202 len: 0 microversion: 2.1 time: 0.151260 Apr 13 20:34:40 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 252/759] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:34:40 2023] POST /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8b310b8c-4bc5-47ac-8196-2553c1a7c3ea tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1728 microversion: 2.1 time: 0.236590 Apr 13 20:34:40 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 256/760] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:40 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:34:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:40 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-762807bc-d924-4107-a94d-2f5fe553dc0e tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044201 Apr 13 20:34:40 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 253/761] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:34:40 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-fdcfc507-e8e8-467e-b88a-36644637509d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aa357970-388f-4b14-b1ca-b792d3a3562a" status: 200 len: 194 microversion: 2.1 time: 0.040138 Apr 13 20:34:40 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 253/762] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 20:34:40 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aa357970-388f-4b14-b1ca-b792d3a3562a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:40 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'services' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:34:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aa357970-388f-4b14-b1ca-b792d3a3562a" status: 202 len: 0 microversion: 2.1 time: 0.189424 Apr 13 20:34:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 257/763] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:34:40 2023] DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aa357970-388f-4b14-b1ca-b792d3a3562a => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:34:41 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:41 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Creating event network-vif-unplugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:34:41 user devstack@n-api.service[61654]: DEBUG nova.compute.api [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61654) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:34:41 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047586 Apr 13 20:34:41 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 254/764] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:43 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:43 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-df58d70c-6872-4fe6-b208-f17acf225ff1 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aaf2141e-9057-4904-acfd-5dad001b1254" status: 200 len: 194 microversion: 2.1 time: 0.137122 Apr 13 20:34:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 254/765] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 20:34:43 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aaf2141e-9057-4904-acfd-5dad001b1254 => generated 194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:43 user devstack@n-api.service[61653]: DEBUG nova.compute.api [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61653) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056596 Apr 13 20:34:43 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 258/766] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:43 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'services' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:34:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aaf2141e-9057-4904-acfd-5dad001b1254" status: 202 len: 0 microversion: 2.1 time: 0.178344 Apr 13 20:34:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 255/767] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:34:43 2023] DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments/aaf2141e-9057-4904-acfd-5dad001b1254 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:34:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:45 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a4d06e19-882a-4b3c-a8ec-f41a4d39fff0 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056136 Apr 13 20:34:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 255/768] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:34:45 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a5ebc862-e7ef-41c5-9d1a-2a2d98425552 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046710 Apr 13 20:34:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 259/769] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:34:46 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:34:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77" status: 204 len: 0 microversion: 2.1 time: 0.125870 Apr 13 20:34:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 256/770] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:34:46 2023] DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:46 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-91b18bc5-7dd2-42a1-b927-ae389d4090ae tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77" status: 200 len: 1659 microversion: 2.1 time: 0.228241 Apr 13 20:34:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 256/771] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:46 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 => generated 1659 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06095354-ac91-443e-8181-dfa44a14ba77", "name": "network-vif-unplugged", "status": "completed", "tag": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] Creating event network-vif-unplugged:0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance 06095354-ac91-443e-8181-dfa44a14ba77 on user Apr 13 20:34:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033103 Apr 13 20:34:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 260/772] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:34:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-44ac9864-63fc-4254-ae51-a400e6aa938e req-c74a2775-26c7-47e9-98b7-7417ba85f8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06095354-ac91-443e-8181-dfa44a14ba77", "name": "network-vif-deleted", "tag": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-44ac9864-63fc-4254-ae51-a400e6aa938e req-c74a2775-26c7-47e9-98b7-7417ba85f8c9 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-44ac9864-63fc-4254-ae51-a400e6aa938e req-c74a2775-26c7-47e9-98b7-7417ba85f8c9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-44ac9864-63fc-4254-ae51-a400e6aa938e req-c74a2775-26c7-47e9-98b7-7417ba85f8c9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-44ac9864-63fc-4254-ae51-a400e6aa938e req-c74a2775-26c7-47e9-98b7-7417ba85f8c9 service nova] Creating event network-vif-deleted:0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance 06095354-ac91-443e-8181-dfa44a14ba77 on user Apr 13 20:34:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-44ac9864-63fc-4254-ae51-a400e6aa938e req-c74a2775-26c7-47e9-98b7-7417ba85f8c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062025 Apr 13 20:34:47 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 257/773] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:48 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06095354-ac91-443e-8181-dfa44a14ba77", "name": "network-vif-plugged", "status": "completed", "tag": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:48 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:48 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] Creating event network-vif-plugged:0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance 06095354-ac91-443e-8181-dfa44a14ba77 on user Apr 13 20:34:48 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040438 Apr 13 20:34:48 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 257/774] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:52 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:34:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:34:52 user devstack@n-api.service[61653]: DEBUG nova.compute.api [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61653) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:34:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062773 Apr 13 20:34:52 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 261/775] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:53 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-674e8297-17e0-4a66-bdd4-dba7ad238e26 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1536 microversion: 2.1 time: 0.161007 Apr 13 20:34:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 258/776] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:53 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1536 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:34:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:34:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:34:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034195 Apr 13 20:34:54 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 258/777] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:34:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:34:56 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:34:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-e2637871-9969-4f25-aab2-820f8822002e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 200 len: 1701 microversion: 2.1 time: 0.296672 Apr 13 20:34:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 262/778] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:34:56 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 1701 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:10 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:35:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" status: 204 len: 0 microversion: 2.1 time: 0.120708 Apr 13 20:35:10 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 259/779] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:35:10 2023] DELETE /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:10 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3993eb2be0d94cdbb16fd233999fc5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd550373054224fcbbb7300f512ad0345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-638b628f-7dd2-48b9-9b37-978addef738f tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" status: 200 len: 1492 microversion: 2.1 time: 0.186157 Apr 13 20:35:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 259/780] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:10 2023] GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 => generated 1492 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:35:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33", "name": "network-vif-unplugged", "status": "completed", "tag": "b0bb456d-5327-4938-8949-7c965ee9221d"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:10 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:10 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] Creating event network-vif-unplugged:b0bb456d-5327-4938-8949-7c965ee9221d for instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 on user Apr 13 20:35:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037536 Apr 13 20:35:10 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 263/781] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:35:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:11 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33", "name": "network-vif-deleted", "tag": "b0bb456d-5327-4938-8949-7c965ee9221d"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] Creating event network-vif-deleted:b0bb456d-5327-4938-8949-7c965ee9221d for instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 on user Apr 13 20:35:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036623 Apr 13 20:35:11 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 260/782] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:35:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:12 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33", "name": "network-vif-plugged", "status": "completed", "tag": "b0bb456d-5327-4938-8949-7c965ee9221d"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] Creating event network-vif-plugged:b0bb456d-5327-4938-8949-7c965ee9221d for instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 on user Apr 13 20:35:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033347 Apr 13 20:35:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 260/783] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:35:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:17 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:17 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1f0d3181-72d8-4f1a-b76f-687df60b2c86 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f" status: 200 len: 1542 microversion: 2.1 time: 0.193815 Apr 13 20:35:17 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 264/784] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:17 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f => generated 1542 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:30 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:30 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-8d82d80c-267b-47b1-a7d5-0da5956f1bb0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1721 microversion: 2.1 time: 0.158730 Apr 13 20:35:30 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 261/785] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:30 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=8 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HTTP exception thrown: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Request method failure captured: Apr 13 20:35:36 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 HTTP/1.1 Apr 13 20:35:36 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:35:36 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:35:36 user devstack@n-api.service[61655]: Connection: close Apr 13 20:35:36 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:35:36 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:35:36 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:35:36 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:35:36 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGRnQSlvJY0liyePr87QQ6EZxvOc4whutvpJuaojawTt6Mlq1K3YtHnK7YYqZJjb2NpmK1Ki4xPIWYsVmPk1IjDfWG_mIO31eL42Qk8-aiS5fwwTSafQ1vIHcrck2B4UTeIubNXdQE7nPCVmK8iQgWV1hsVNPERJNKqQE1EWPAqCXyA Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Project-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}] Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Tenant-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:36 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:36 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:36 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:35:36 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:35:36 user devstack@n-api.service[61655]: X-User-Id: b5210a73b1574e82838f3f0ccef93a25 Apr 13 20:35:36 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:36 user devstack@n-api.service[61655]: method: > Apr 13 20:35:36 user devstack@n-api.service[61655]: exception: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:36 user devstack@n-api.service[61655]: action_args: {'id': '06095354-ac91-443e-8181-dfa44a14ba77'} Apr 13 20:35:36 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:36 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Returning 404 to user: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:35:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-870f5f2e-9214-461c-86ec-1e764ad8982d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77" status: 404 len: 111 microversion: 2.1 time: 0.043543 Apr 13 20:35:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 261/786] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:36 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:35:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2050b6fc-e6b9-4882-a9b6-1e029f849c95 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '.version_select at 0x7f78381fbe20>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:36 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:36 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2050b6fc-e6b9-4882-a9b6-1e029f849c95 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677859878" status: 202 len: 0 microversion: 2.1 time: 0.037783 Apr 13 20:35:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 265/787] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 20:35:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677859878 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:39 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-dc00dd40-cc1c-4f84-95ea-5a05b8f2bdd7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1" status: 200 len: 1551 microversion: 2.1 time: 0.170082 Apr 13 20:35:40 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 262/788] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:39 2023] GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 => generated 1551 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:40 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:35:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1" status: 204 len: 0 microversion: 2.1 time: 0.142896 Apr 13 20:35:40 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 262/789] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:35:40 2023] DELETE /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:40 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b73e6b4d-7adf-4099-bade-72aab10b4e82 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1" status: 200 len: 1557 microversion: 2.1 time: 0.215932 Apr 13 20:35:40 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 266/790] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:40 2023] GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:35:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5940c278-df77-472e-a32f-e431c5f4b1d1", "name": "network-vif-unplugged", "status": "completed", "tag": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] Creating event network-vif-unplugged:c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance 5940c278-df77-472e-a32f-e431c5f4b1d1 on user Apr 13 20:35:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030928 Apr 13 20:35:40 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 263/791] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:35:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:41 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5940c278-df77-472e-a32f-e431c5f4b1d1", "name": "network-vif-deleted", "tag": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] Creating event network-vif-deleted:c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance 5940c278-df77-472e-a32f-e431c5f4b1d1 on user Apr 13 20:35:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034828 Apr 13 20:35:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 263/792] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:35:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:42 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5940c278-df77-472e-a32f-e431c5f4b1d1", "name": "network-vif-plugged", "status": "completed", "tag": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] Creating event network-vif-plugged:c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance 5940c278-df77-472e-a32f-e431c5f4b1d1 on user Apr 13 20:35:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034277 Apr 13 20:35:42 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 267/793] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:35:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HTTP exception thrown: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Request method failure captured: Apr 13 20:35:42 user devstack@n-api.service[61654]: request: DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 HTTP/1.1 Apr 13 20:35:42 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:35:42 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:35:42 user devstack@n-api.service[61654]: Connection: close Apr 13 20:35:42 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:35:42 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:35:42 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:35:42 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:35:42 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGRnQSlvJY0liyePr87QQ6EZxvOc4whutvpJuaojawTt6Mlq1K3YtHnK7YYqZJjb2NpmK1Ki4xPIWYsVmPk1IjDfWG_mIO31eL42Qk8-aiS5fwwTSafQ1vIHcrck2B4UTeIubNXdQE7nPCVmK8iQgWV1hsVNPERJNKqQE1EWPAqCXyA Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Project-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Project-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}] Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Tenant: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Tenant-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:42 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:42 user devstack@n-api.service[61654]: X-User: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:42 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:35:42 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:35:42 user devstack@n-api.service[61654]: X-User-Id: b5210a73b1574e82838f3f0ccef93a25 Apr 13 20:35:42 user devstack@n-api.service[61654]: X-User-Name: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:42 user devstack@n-api.service[61654]: method: > Apr 13 20:35:42 user devstack@n-api.service[61654]: exception: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61654]: action_args: {'id': '06095354-ac91-443e-8181-dfa44a14ba77'} Apr 13 20:35:42 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Returning 404 to user: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:35:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-46b9382e-5c23-471c-9998-437fdab48824 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77" status: 404 len: 111 microversion: 2.1 time: 0.044204 Apr 13 20:35:42 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 264/794] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:35:42 2023] DELETE /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HTTP exception thrown: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Request method failure captured: Apr 13 20:35:42 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 HTTP/1.1 Apr 13 20:35:42 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:35:42 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:35:42 user devstack@n-api.service[61655]: Connection: close Apr 13 20:35:42 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:35:42 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:35:42 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:35:42 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:35:42 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGRnQSlvJY0liyePr87QQ6EZxvOc4whutvpJuaojawTt6Mlq1K3YtHnK7YYqZJjb2NpmK1Ki4xPIWYsVmPk1IjDfWG_mIO31eL42Qk8-aiS5fwwTSafQ1vIHcrck2B4UTeIubNXdQE7nPCVmK8iQgWV1hsVNPERJNKqQE1EWPAqCXyA Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Project-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}] Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Tenant-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:42 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:42 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:42 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:35:42 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:35:42 user devstack@n-api.service[61655]: X-User-Id: b5210a73b1574e82838f3f0ccef93a25 Apr 13 20:35:42 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:42 user devstack@n-api.service[61655]: method: > Apr 13 20:35:42 user devstack@n-api.service[61655]: exception: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61655]: action_args: {'id': '06095354-ac91-443e-8181-dfa44a14ba77'} Apr 13 20:35:42 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. Apr 13 20:35:42 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Returning 404 to user: Instance 06095354-ac91-443e-8181-dfa44a14ba77 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:35:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b2b922cc-a13d-4c53-b23d-028c49a55d25 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77" status: 404 len: 111 microversion: 2.1 time: 0.036200 Apr 13 20:35:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 264/795] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:42 2023] GET /compute/v2.1/servers/06095354-ac91-443e-8181-dfa44a14ba77 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HTTP exception thrown: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Request method failure captured: Apr 13 20:35:46 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db HTTP/1.1 Apr 13 20:35:46 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:35:46 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:35:46 user devstack@n-api.service[61653]: Connection: close Apr 13 20:35:46 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:35:46 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:35:46 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:35:46 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:35:46 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGRnQSlvJY0liyePr87QQ6EZxvOc4whutvpJuaojawTt6Mlq1K3YtHnK7YYqZJjb2NpmK1Ki4xPIWYsVmPk1IjDfWG_mIO31eL42Qk8-aiS5fwwTSafQ1vIHcrck2B4UTeIubNXdQE7nPCVmK8iQgWV1hsVNPERJNKqQE1EWPAqCXyA Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Project-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}] Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Tenant-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:46 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:46 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:46 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:35:46 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:35:46 user devstack@n-api.service[61653]: X-User-Id: b5210a73b1574e82838f3f0ccef93a25 Apr 13 20:35:46 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:46 user devstack@n-api.service[61653]: method: > Apr 13 20:35:46 user devstack@n-api.service[61653]: exception: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61653]: action_args: {'id': '7d01394e-edb8-4c51-a71a-e07c0ee164db'} Apr 13 20:35:46 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Returning 404 to user: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:35:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d6d10f45-9524-4863-8b8c-3ac76145be77 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 404 len: 111 microversion: 2.1 time: 0.031933 Apr 13 20:35:46 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 268/796] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:35:46 2023] DELETE /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HTTP exception thrown: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Request method failure captured: Apr 13 20:35:46 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db HTTP/1.1 Apr 13 20:35:46 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:35:46 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:35:46 user devstack@n-api.service[61654]: Connection: close Apr 13 20:35:46 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:35:46 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:35:46 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:35:46 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:35:46 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGRnQSlvJY0liyePr87QQ6EZxvOc4whutvpJuaojawTt6Mlq1K3YtHnK7YYqZJjb2NpmK1Ki4xPIWYsVmPk1IjDfWG_mIO31eL42Qk8-aiS5fwwTSafQ1vIHcrck2B4UTeIubNXdQE7nPCVmK8iQgWV1hsVNPERJNKqQE1EWPAqCXyA Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Project-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Project-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/587bca93ee3f45b9b5b1ceb91e972e7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/587bca93ee3f45b9b5b1ceb91e972e7b"}]}] Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Tenant: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Tenant-Id: 587bca93ee3f45b9b5b1ceb91e972e7b Apr 13 20:35:46 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1545246928 Apr 13 20:35:46 user devstack@n-api.service[61654]: X-User: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:46 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:35:46 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:35:46 user devstack@n-api.service[61654]: X-User-Id: b5210a73b1574e82838f3f0ccef93a25 Apr 13 20:35:46 user devstack@n-api.service[61654]: X-User-Name: tempest-AttachVolumeTestJSON-1545246928-project-member Apr 13 20:35:46 user devstack@n-api.service[61654]: method: > Apr 13 20:35:46 user devstack@n-api.service[61654]: exception: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61654]: action_args: {'id': '7d01394e-edb8-4c51-a71a-e07c0ee164db'} Apr 13 20:35:46 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. Apr 13 20:35:46 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:35:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Returning 404 to user: Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:35:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-8cb566f0-c3ea-4d9d-aa6a-9850317c6909 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db" status: 404 len: 111 microversion: 2.1 time: 0.035545 Apr 13 20:35:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 265/797] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:46 2023] GET /compute/v2.1/servers/7d01394e-edb8-4c51-a71a-e07c0ee164db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:54 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-3ee3e1a5-780a-48b7-a950-9df62a081c89 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1536 microversion: 2.1 time: 0.161417 Apr 13 20:35:54 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 265/798] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:54 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1536 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Searching by: {'deleted': False, 'project_id': '41f1e999778042e2a606a2ae4072bc83'} {{(pid=61653) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:54 user devstack@n-api.service[61653]: DEBUG nova.compute.multi_cell_list [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61653) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 20:35:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-bafe1dcf-1102-4663-ba4b-108d4bb0c10f tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.171841 Apr 13 20:35:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 269/799] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 20:35:54 2023] GET /compute/v2.1/servers => generated 340 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:54 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:54 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-13438db9-38df-4fb6-ae5a-485574ac095a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1536 microversion: 2.1 time: 0.132246 Apr 13 20:35:54 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 266/800] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:54 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1536 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] HTTP exception thrown: Cannot 'detach_volume' instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 while it is in vm_state rescued Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Request method failure captured: Apr 13 20:35:56 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments/ea7203e7-62fc-4103-9662-be40fbd06e1e HTTP/1.1 Apr 13 20:35:56 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:35:56 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:35:56 user devstack@n-api.service[61655]: Connection: close Apr 13 20:35:56 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:35:56 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:35:56 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:35:56 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:35:56 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTHgU60gk6XNAecNfjeV73oUVK3OFrxGuyxBDmBdpLccBf10jTlE1CaE_8bPrOXWx15S3RgKgr1HUp5WGNhons5akLZT2gu7-Lydy2p8O9V3IRTJEtQnypqwv35JAR3FcpsnAbcjx6JdBEO9GPBYvn3J-f139TWaVCNjyaFWyVSeZU Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Project-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}] Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Tenant-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:35:56 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:35:56 user devstack@n-api.service[61655]: X-User: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:35:56 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:35:56 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:35:56 user devstack@n-api.service[61655]: X-User-Id: c89de9f7e5014fa8b0ff7b808bedfb91 Apr 13 20:35:56 user devstack@n-api.service[61655]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:35:56 user devstack@n-api.service[61655]: method: > Apr 13 20:35:56 user devstack@n-api.service[61655]: exception: Cannot 'detach_volume' instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 while it is in vm_state rescued Apr 13 20:35:56 user devstack@n-api.service[61655]: action_args: {'server_id': 'fd729f88-fb57-4e9b-9cb8-645dcd4ae441', 'id': 'ea7203e7-62fc-4103-9662-be40fbd06e1e'} Apr 13 20:35:56 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 while it is in vm_state rescued Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 while it is in vm_state rescued Apr 13 20:35:56 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:35:56 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Returning 409 to user: Cannot 'detach_volume' instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 while it is in vm_state rescued {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:35:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2ff839dc-e276-4eab-be96-cd2572eb4b8b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments/ea7203e7-62fc-4103-9662-be40fbd06e1e" status: 409 len: 152 microversion: 2.1 time: 0.134403 Apr 13 20:35:56 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 266/801] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:35:56 2023] DELETE /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments/ea7203e7-62fc-4103-9662-be40fbd06e1e => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 20:35:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:56 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/action" status: 202 len: 0 microversion: 2.1 time: 0.096327 Apr 13 20:35:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 270/802] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:35:56 2023] POST /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:57 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:35:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ce972ad9-5a2b-4543-af84-f3caeb76deaa tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 200 len: 1709 microversion: 2.1 time: 0.159220 Apr 13 20:35:57 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 267/803] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:35:57 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:35:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:57 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:35:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287606 Apr 13 20:35:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 267/804] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:35:57 2023] POST /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:57 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-unplugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] Creating event network-vif-unplugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:35:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031914 Apr 13 20:35:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 271/805] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:35:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:35:59 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}, {"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:35:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:35:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:35:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:35:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:35:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:35:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033727 Apr 13 20:35:59 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 268/806] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:35:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:00 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] HTTP exception thrown: Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 could not be found. Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Request method failure captured: Apr 13 20:36:00 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 HTTP/1.1 Apr 13 20:36:00 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:36:00 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:36:00 user devstack@n-api.service[61655]: Connection: close Apr 13 20:36:00 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:36:00 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:36:00 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:36:00 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:36:00 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGcMhA0ZBjkgVRxrirXm1IsUwWpgd5ZzCJIZpHEemdpiAEqUfnpUuJOoFnGBFhnTTydd9_M_isbx0hOk8GaTslIHPTdtJSVy0QG0gh2HWqtfc-7YlOnuK9Ku6esil4he7jxsVVUg34Qmoro2hy9rKjAZbZJtzgMaNrILCXJpNHEOHtw Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Project-Id: d550373054224fcbbb7300f512ad0345 Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Project-Name: tempest-VolumesActionsTest-1802743389 Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d550373054224fcbbb7300f512ad0345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d550373054224fcbbb7300f512ad0345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d550373054224fcbbb7300f512ad0345"}]}] Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Tenant: tempest-VolumesActionsTest-1802743389 Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Tenant-Id: d550373054224fcbbb7300f512ad0345 Apr 13 20:36:00 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-VolumesActionsTest-1802743389 Apr 13 20:36:00 user devstack@n-api.service[61655]: X-User: tempest-VolumesActionsTest-1802743389-project-member Apr 13 20:36:00 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:36:00 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:36:00 user devstack@n-api.service[61655]: X-User-Id: 3993eb2be0d94cdbb16fd233999fc5c2 Apr 13 20:36:00 user devstack@n-api.service[61655]: X-User-Name: tempest-VolumesActionsTest-1802743389-project-member Apr 13 20:36:00 user devstack@n-api.service[61655]: method: > Apr 13 20:36:00 user devstack@n-api.service[61655]: exception: Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 could not be found. Apr 13 20:36:00 user devstack@n-api.service[61655]: action_args: {'id': 'a2e756a6-be8f-4c1b-a9b0-182d97b8bf33'} Apr 13 20:36:00 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 could not be found. Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 could not be found. Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 could not be found. Apr 13 20:36:00 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:36:00 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Returning 404 to user: Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:36:00 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-e673cafd-84c6-4c6d-a632-b39bad1dfff1 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" status: 404 len: 111 microversion: 2.1 time: 0.030889 Apr 13 20:36:00 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 268/807] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:00 2023] GET /compute/v2.1/servers/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-323195761", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "72b4976e-72c4-4595-8a8c-89a79ac21d49"}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] validate_networks() for [('72b4976e-72c4-4595-8a8c-89a79ac21d49', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Getting quotas for project d550373054224fcbbb7300f512ad0345. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Getting quotas for user 3993eb2be0d94cdbb16fd233999fc5c2 and project d550373054224fcbbb7300f512ad0345. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:36:01 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:36:01 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.620233 Apr 13 20:36:01 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 272/808] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:36:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:36:01 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-f25295d3-104b-46b8-baa2-d747ff99083a tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:01 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-f25295d3-104b-46b8-baa2-d747ff99083a tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:01 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=17 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:01 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-f25295d3-104b-46b8-baa2-d747ff99083a tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3993eb2be0d94cdbb16fd233999fc5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd550373054224fcbbb7300f512ad0345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:01 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-f25295d3-104b-46b8-baa2-d747ff99083a tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5" status: 200 len: 1207 microversion: 2.1 time: 0.064362 Apr 13 20:36:01 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 269/809] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:01 2023] GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5 => generated 1207 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:01 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:36:02 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069751 Apr 13 20:36:02 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 269/810] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4eb9e9-983d-4009-8e32-56a4494961c5", "tag": "7f1026a7-0645-4eae-8338-5275284ecf2e"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] Creating event network-changed:7f1026a7-0645-4eae-8338-5275284ecf2e for instance ea4eb9e9-983d-4009-8e32-56a4494961c5 on user Apr 13 20:36:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037143 Apr 13 20:36:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 273/811] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=33 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:05 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:05 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6a755ec7-9041-4aca-9e2f-713a01f07273 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1582 microversion: 2.1 time: 0.304059 Apr 13 20:36:05 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 270/812] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:05 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1582 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:06 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4eb9e9-983d-4009-8e32-56a4494961c5", "name": "network-vif-plugged", "status": "completed", "tag": "7f1026a7-0645-4eae-8338-5275284ecf2e"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:06 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] Creating event network-vif-plugged:7f1026a7-0645-4eae-8338-5275284ecf2e for instance ea4eb9e9-983d-4009-8e32-56a4494961c5 on user Apr 13 20:36:06 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068780 Apr 13 20:36:06 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 270/813] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:08 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4eb9e9-983d-4009-8e32-56a4494961c5", "name": "network-vif-plugged", "status": "completed", "tag": "7f1026a7-0645-4eae-8338-5275284ecf2e"}, {"name": "network-changed", "server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:08 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:08 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Creating event network-vif-plugged:7f1026a7-0645-4eae-8338-5275284ecf2e for instance ea4eb9e9-983d-4009-8e32-56a4494961c5 on user Apr 13 20:36:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Creating event network-changed:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:36:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047023 Apr 13 20:36:08 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 274/814] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:08 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:09 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1995711390"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:09 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:09 user devstack@n-api.service[61654]: INFO nova.network.security_group_api [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Adding security group 2c2324b9-af28-4036-aeb4-39883423e671 to port 8e8101de-d339-437b-b94c-e40a63e6e6aa Apr 13 20:36:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-756592bc-c1e4-4776-88e2-dbd2fc2edbf4 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/action" status: 202 len: 0 microversion: 2.1 time: 0.610895 Apr 13 20:36:10 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 271/815] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:36:09 2023] POST /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7404123f-3109-4381-aa5f-081b3a07ade7 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1748 microversion: 2.1 time: 0.249266 Apr 13 20:36:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 271/816] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:10 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1748 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:36:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] Creating event network-changed:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:36:10 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270800 Apr 13 20:36:10 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 275/817] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:10 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:10 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:10 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/action" status: 202 len: 0 microversion: 2.1 time: 0.092213 Apr 13 20:36:10 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 272/818] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:36:10 2023] POST /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:10 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-35b2c811-d60a-4cae-821b-2f619f9ec935 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1740 microversion: 2.1 time: 0.230027 Apr 13 20:36:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 272/819] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:10 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:14 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:14 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:14 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-unplugged", "status": "completed", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:14 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] Creating event network-vif-unplugged:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:36:14 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043903 Apr 13 20:36:14 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 276/820] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:16 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-plugged", "status": "completed", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:16 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] Creating event network-vif-plugged:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:36:16 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041108 Apr 13 20:36:16 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 273/821] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:17 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:17 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:17 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-99e18791-9fba-4a4e-9bba-e3b5d88c09d5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.105122 Apr 13 20:36:17 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 273/822] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:36:17 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-interface => generated 282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:18 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-plugged", "status": "completed", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}, {"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-plugged", "status": "completed", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:18 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Creating event network-vif-plugged:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:36:18 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Creating event network-vif-plugged:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:36:18 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037832 Apr 13 20:36:18 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 277/823] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:18 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bdf333a-456b-413b-92d6-87e45474905f", "tag": "343a5e66-81f2-407f-a646-cc52fdd762c9"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:18 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:18 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] Creating event network-changed:343a5e66-81f2-407f-a646-cc52fdd762c9 for instance 0bdf333a-456b-413b-92d6-87e45474905f on user Apr 13 20:36:18 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040363 Apr 13 20:36:18 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 274/824] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:19 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:19 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-0ad06306-a1da-4c78-99b0-62aeb721db23 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/ips" status: 200 len: 147 microversion: 2.1 time: 0.046553 Apr 13 20:36:19 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 274/825] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 20:36:19 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/ips => generated 147 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:21 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:21 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:21 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:21 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:21 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:21 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:21 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:21 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:21 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707759 Apr 13 20:36:21 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 278/826] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:36:21 2023] POST /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=13 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:29 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'services' on Instance uuid 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:36:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-volume_attachments/1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6" status: 202 len: 0 microversion: 2.1 time: 0.184883 Apr 13 20:36:29 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 275/827] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:36:29 2023] DELETE /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-volume_attachments/1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=20 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-5824954c-f2e1-4ba0-af3f-8b50062c28ce tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054398 Apr 13 20:36:29 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 275/828] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:36:29 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:36:30 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 HTTP/1.1 Apr 13 20:36:30 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:36:30 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:36:30 user devstack@n-api.service[61653]: Connection: close Apr 13 20:36:30 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:36:30 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:36:30 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:36:30 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:36:30 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:36:30 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:36:30 user devstack@n-api.service[61653]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:36:30 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:36:30 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:36:30 user devstack@n-api.service[61653]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:36:30 user devstack@n-api.service[61653]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:36:30 user devstack@n-api.service[61653]: method: > Apr 13 20:36:30 user devstack@n-api.service[61653]: exception: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:36:30 user devstack@n-api.service[61653]: action_args: {'id': '5940c278-df77-472e-a32f-e431c5f4b1d1'} Apr 13 20:36:30 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:36:30 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:36:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:36:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-55301d9a-e4f2-4e02-8b91-e5a2d09b8401 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1" status: 404 len: 111 microversion: 2.1 time: 0.055347 Apr 13 20:36:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 279/829] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:30 2023] GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:36:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:30 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:31 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:31 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-f87ad227-0c59-47d2-8c95-9f3f51bf33ee tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1721 microversion: 2.1 time: 0.187716 Apr 13 20:36:31 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 276/830] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:30 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:31 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:31 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-abe5fbc5-5f6f-4939-81ac-953204d5d8d6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1721 microversion: 2.1 time: 0.237087 Apr 13 20:36:31 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 276/831] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:31 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:34 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:36:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c11c4d9c-88c8-46c7-8b1c-99768aa6d2f2 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Action: 'create', calling method: .version_select at 0x7f7833d8bbe0>, body: {"keypair": {"name": "tempest-TestShelveInstance-455469676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnZUWq96lLQWm647DGAaRq6+rWKgdmIWyN/Z8MUSyiSM9qp5+NoLJa0pen2ZdlQna4LIuZyhqJfhQ+SDeG8Acqb8lYZOWAIaEsWHKVjuYIBLdCciq2oo0X92SlPcgzf2Q=="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590" status: 204 len: 0 microversion: 2.1 time: 0.120698 Apr 13 20:36:35 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 277/832] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:36:34 2023] DELETE /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:36:35 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-c11c4d9c-88c8-46c7-8b1c-99768aa6d2f2 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Getting quotas for project e0749bcd26454f179454d9f9cacbfbdb. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:35 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-c11c4d9c-88c8-46c7-8b1c-99768aa6d2f2 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Getting quotas for user 99bfa0ed895e4574a3e0532e588ca74a and project e0749bcd26454f179454d9f9cacbfbdb. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:35 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c11c4d9c-88c8-46c7-8b1c-99768aa6d2f2 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.251692 Apr 13 20:36:35 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 280/833] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:36:34 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:35 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:35 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-14badc08-e31a-47bf-8e1d-adb8fdcbca77 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590" status: 200 len: 1398 microversion: 2.1 time: 0.199174 Apr 13 20:36:35 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 277/834] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:35 2023] GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 => generated 1398 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:35 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6800d3-8537-4a89-877a-c049f0670590", "name": "network-vif-unplugged", "status": "completed", "tag": "d4d99364-e2da-4757-ab7c-38f903f15a19"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] Creating event network-vif-unplugged:d4d99364-e2da-4757-ab7c-38f903f15a19 for instance 3e6800d3-8537-4a89-877a-c049f0670590 on user Apr 13 20:36:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032360 Apr 13 20:36:35 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 278/835] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:36 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6800d3-8537-4a89-877a-c049f0670590", "name": "network-vif-deleted", "tag": "d4d99364-e2da-4757-ab7c-38f903f15a19"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:36 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] Creating event network-vif-deleted:d4d99364-e2da-4757-ab7c-38f903f15a19 for instance 3e6800d3-8537-4a89-877a-c049f0670590 on user Apr 13 20:36:36 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030691 Apr 13 20:36:36 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 281/836] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:37 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6800d3-8537-4a89-877a-c049f0670590", "name": "network-vif-plugged", "status": "completed", "tag": "d4d99364-e2da-4757-ab7c-38f903f15a19"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:37 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] Creating event network-vif-plugged:d4d99364-e2da-4757-ab7c-38f903f15a19 for instance 3e6800d3-8537-4a89-877a-c049f0670590 on user Apr 13 20:36:37 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030838 Apr 13 20:36:37 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 278/837] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:39 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2081085367", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-455469676", "security_groups": [{"name": "tempest-secgroup-smoke-519915092"}], "networks": [{"uuid": "49cd1e10-091e-47de-a17d-e26ea8103270"}], "block_device_mapping_v2": [{"uuid": "7127ca39-0a83-4dda-a67e-4630b25fd4a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] validate_networks() for [('49cd1e10-091e-47de-a17d-e26ea8103270', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Getting quotas for project e0749bcd26454f179454d9f9cacbfbdb. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Getting quotas for user 99bfa0ed895e4574a3e0532e588ca74a and project e0749bcd26454f179454d9f9cacbfbdb. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:36:40 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7127ca39-0a83-4dda-a67e-4630b25fd4a1',volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:36:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.981925 Apr 13 20:36:40 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 279/838] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:36:39 2023] POST /compute/v2.1/servers => generated 403 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:36:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3f92ce2b-d971-4576-85c3-6b24e9a252b8 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:40 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3f92ce2b-d971-4576-85c3-6b24e9a252b8 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:41 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-3f92ce2b-d971-4576-85c3-6b24e9a252b8 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3f92ce2b-d971-4576-85c3-6b24e9a252b8 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 200 len: 1083 microversion: 2.1 time: 0.072252 Apr 13 20:36:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 282/839] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:40 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 1083 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] Creating event network-changed:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:36:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031738 Apr 13 20:36:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 279/840] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:47 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a91e094a-23c2-448c-ad21-b529c4e6f4df tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 200 len: 1715 microversion: 2.1 time: 0.138669 Apr 13 20:36:47 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 280/841] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:47 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 1715 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:50 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-plugged", "status": "completed", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:50 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:50 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] Creating event network-vif-plugged:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:36:50 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060875 Apr 13 20:36:50 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 283/842] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:51 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3993eb2be0d94cdbb16fd233999fc5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd550373054224fcbbb7300f512ad0345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:36:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-409cfbb7-d257-4460-8175-d7be893ecbba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5" status: 200 len: 1486 microversion: 2.1 time: 0.148541 Apr 13 20:36:52 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 280/843] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:36:51 2023] GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5 => generated 1486 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:36:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-plugged", "status": "completed", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:36:52 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:52 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:36:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:36:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:36:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:36:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] Creating event network-vif-plugged:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:36:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031498 Apr 13 20:36:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 281/844] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:36:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=5 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:01 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:37:01 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b1957393-af8e-47de-8cc9-9f6951da9c17 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1748 microversion: 2.1 time: 0.182521 Apr 13 20:37:01 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 284/845] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:01 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1748 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:37:19 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=12 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:19 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=28 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:19 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:19 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-fc0b9443-0ad4-4a1a-8bb0-703cd0404d9d tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057539 Apr 13 20:37:20 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 281/846] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:37:19 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:20 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:37:20 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f" status: 204 len: 0 microversion: 2.1 time: 0.124421 Apr 13 20:37:20 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 282/847] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:37:20 2023] DELETE /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:20 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:37:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7a01853e-66ce-442b-84df-90008c49edb4 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f" status: 200 len: 1667 microversion: 2.1 time: 0.161339 Apr 13 20:37:20 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 285/848] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:20 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdf333a-456b-413b-92d6-87e45474905f", "name": "network-vif-unplugged", "status": "completed", "tag": "343a5e66-81f2-407f-a646-cc52fdd762c9"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] Creating event network-vif-unplugged:343a5e66-81f2-407f-a646-cc52fdd762c9 for instance 0bdf333a-456b-413b-92d6-87e45474905f on user Apr 13 20:37:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028945 Apr 13 20:37:20 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 282/849] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdf333a-456b-413b-92d6-87e45474905f", "name": "network-vif-plugged", "status": "completed", "tag": "343a5e66-81f2-407f-a646-cc52fdd762c9"}, {"server_uuid": "0bdf333a-456b-413b-92d6-87e45474905f", "name": "network-vif-deleted", "tag": "343a5e66-81f2-407f-a646-cc52fdd762c9"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Creating event network-vif-plugged:343a5e66-81f2-407f-a646-cc52fdd762c9 for instance 0bdf333a-456b-413b-92d6-87e45474905f on user Apr 13 20:37:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Creating event network-vif-deleted:343a5e66-81f2-407f-a646-cc52fdd762c9 for instance 0bdf333a-456b-413b-92d6-87e45474905f on user Apr 13 20:37:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033409 Apr 13 20:37:22 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 283/850] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:37:25 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 HTTP/1.1 Apr 13 20:37:25 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:37:25 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:37:25 user devstack@n-api.service[61653]: Connection: close Apr 13 20:37:25 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:37:25 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:37:25 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:37:25 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:37:25 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61653]: method: > Apr 13 20:37:25 user devstack@n-api.service[61653]: exception: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: action_args: {'id': '3e6800d3-8537-4a89-877a-c049f0670590'} Apr 13 20:37:25 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:37:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2ccd99cc-1a7a-4ea1-9ca6-2f1bcc64345e tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590" status: 404 len: 111 microversion: 2.1 time: 0.028967 Apr 13 20:37:25 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 286/851] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:25 2023] GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:37:25 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 HTTP/1.1 Apr 13 20:37:25 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:37:25 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:37:25 user devstack@n-api.service[61655]: Connection: close Apr 13 20:37:25 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:37:25 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:37:25 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:37:25 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:37:25 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61655]: method: > Apr 13 20:37:25 user devstack@n-api.service[61655]: exception: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: action_args: {'id': '5940c278-df77-472e-a32f-e431c5f4b1d1'} Apr 13 20:37:25 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:37:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a6829920-4106-4327-b45c-f754068cc83c tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1" status: 404 len: 111 microversion: 2.1 time: 0.028534 Apr 13 20:37:25 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 283/852] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:37:25 2023] DELETE /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:37:25 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 HTTP/1.1 Apr 13 20:37:25 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:37:25 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:37:25 user devstack@n-api.service[61654]: Connection: close Apr 13 20:37:25 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:37:25 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:37:25 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:37:25 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:37:25 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61654]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61654]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:37:25 user devstack@n-api.service[61654]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61654]: method: > Apr 13 20:37:25 user devstack@n-api.service[61654]: exception: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61654]: action_args: {'id': '5940c278-df77-472e-a32f-e431c5f4b1d1'} Apr 13 20:37:25 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:37:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-dd2799f2-373c-407f-abbf-0ea28849ed9b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1" status: 404 len: 111 microversion: 2.1 time: 0.027592 Apr 13 20:37:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 284/853] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:25 2023] GET /compute/v2.1/servers/5940c278-df77-472e-a32f-e431c5f4b1d1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:37:25 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 HTTP/1.1 Apr 13 20:37:25 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:37:25 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:37:25 user devstack@n-api.service[61653]: Connection: close Apr 13 20:37:25 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:37:25 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:37:25 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:37:25 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:37:25 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:37:25 user devstack@n-api.service[61653]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61653]: method: > Apr 13 20:37:25 user devstack@n-api.service[61653]: exception: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: action_args: {'id': '3e6800d3-8537-4a89-877a-c049f0670590'} Apr 13 20:37:25 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:37:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1e2b3cd2-aeb3-4f1c-b906-eb363f796cb6 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590" status: 404 len: 111 microversion: 2.1 time: 0.026995 Apr 13 20:37:25 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 287/854] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:37:25 2023] DELETE /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:37:25 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 HTTP/1.1 Apr 13 20:37:25 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:37:25 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:37:25 user devstack@n-api.service[61655]: Connection: close Apr 13 20:37:25 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:37:25 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:37:25 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:37:25 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:37:25 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:37:25 user devstack@n-api.service[61655]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:37:25 user devstack@n-api.service[61655]: method: > Apr 13 20:37:25 user devstack@n-api.service[61655]: exception: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: action_args: {'id': '3e6800d3-8537-4a89-877a-c049f0670590'} Apr 13 20:37:25 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. Apr 13 20:37:25 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:37:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:37:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ffacfa58-aa4c-4aba-a60d-2b1593b8c71d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590" status: 404 len: 111 microversion: 2.1 time: 0.029862 Apr 13 20:37:25 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 284/855] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:25 2023] GET /compute/v2.1/servers/3e6800d3-8537-4a89-877a-c049f0670590 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7c5d8ec3-37e2-4fd1-a594-7cc520b23319 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Action: 'create', calling method: .version_select at 0x7f7833fe8af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1472807234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA=="}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-7c5d8ec3-37e2-4fd1-a594-7cc520b23319 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for project 65dc7126add94e0c97afbe225c8447a4. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:37:25 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-7c5d8ec3-37e2-4fd1-a594-7cc520b23319 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for user 7e478a11b57b4ee385e33c4709adf04b and project 65dc7126add94e0c97afbe225c8447a4. Resources: {'key_pairs'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:37:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7c5d8ec3-37e2-4fd1-a594-7cc520b23319 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.043439 Apr 13 20:37:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 285/856] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:37:25 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1706849453", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1472807234", "security_groups": [{"name": "tempest-secgroup-smoke-1432409068"}], "block_device_mapping_v2": [{"uuid": "45e7808c-5141-44a8-bdae-b556a6b5578c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0"}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:29 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] validate_networks() for [('e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for user 7e478a11b57b4ee385e33c4709adf04b and project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:37:30 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45e7808c-5141-44a8-bdae-b556a6b5578c',volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:37:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.727054 Apr 13 20:37:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 288/857] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:37:29 2023] POST /compute/v2.1/servers => generated 404 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:37:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-16fb55b5-a026-4b78-99bb-788486b508dd tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:30 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-16fb55b5-a026-4b78-99bb-788486b508dd tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:30 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-16fb55b5-a026-4b78-99bb-788486b508dd tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:37:30 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-16fb55b5-a026-4b78-99bb-788486b508dd tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444" status: 200 len: 1090 microversion: 2.1 time: 0.073332 Apr 13 20:37:30 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 285/858] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:30 2023] GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 => generated 1090 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:31 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:37:31 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2455e227-4e3c-4a9f-af20-29cc369d716f tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 200 len: 1432 microversion: 2.1 time: 0.149476 Apr 13 20:37:31 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 286/859] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:31 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 1432 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:31 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:37:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 204 len: 0 microversion: 2.1 time: 0.230369 Apr 13 20:37:31 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 289/860] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:37:31 2023] DELETE /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:37:31 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:31 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:32 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] Creating event network-vif-unplugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:37:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053504 Apr 13 20:37:32 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 287/861] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:32 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:37:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-98a07ee5-4577-42aa-bef3-1a4d026ceb80 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 200 len: 1727 microversion: 2.1 time: 0.446701 Apr 13 20:37:32 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 286/862] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:31 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 1727 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:37:33 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c4d5801-3b71-4ce3-83b9-9bf54507c444", "tag": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:33 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] Creating event network-changed:9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 on user Apr 13 20:37:33 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053116 Apr 13 20:37:33 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 290/863] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-deleted", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] Creating event network-vif-deleted:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:37:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030222 Apr 13 20:37:34 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 288/864] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:34 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bcf189-a781-474e-bc4f-8a471a661e93", "name": "network-vif-plugged", "status": "completed", "tag": "2a0918fa-0318-4cee-aa86-e65201b06aa8"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] Creating event network-vif-plugged:2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 on user Apr 13 20:37:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030725 Apr 13 20:37:34 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 287/865] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:39 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4d5801-3b71-4ce3-83b9-9bf54507c444", "name": "network-vif-plugged", "status": "completed", "tag": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:39 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] Creating event network-vif-plugged:9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 on user Apr 13 20:37:39 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034163 Apr 13 20:37:39 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 291/866] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:41 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:41 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4d5801-3b71-4ce3-83b9-9bf54507c444", "name": "network-vif-plugged", "status": "completed", "tag": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:41 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:41 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] Creating event network-vif-plugged:9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 on user Apr 13 20:37:41 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034908 Apr 13 20:37:41 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 289/867] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=16 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=20 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:47 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:47 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-700e4a5a-2c46-440a-8c09-d9e28135ab1b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.099993 Apr 13 20:37:47 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 288/868] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:37:47 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-interface => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:37:48 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:48 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:48 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:48 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:48 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] Creating event network-changed:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:37:48 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033122 Apr 13 20:37:48 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 292/869] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:48 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'services' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:37:48 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments/ea7203e7-62fc-4103-9662-be40fbd06e1e" status: 202 len: 0 microversion: 2.1 time: 0.228600 Apr 13 20:37:48 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 290/870] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:37:48 2023] DELETE /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments/ea7203e7-62fc-4103-9662-be40fbd06e1e => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:37:48 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:48 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:48 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:48 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-59787335-110d-48c1-9cf5-c37791eb8ac6 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077839 Apr 13 20:37:48 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 289/871] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:37:48 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:50 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:50 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:50 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:50 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:50 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] Creating event network-changed:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:37:50 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048064 Apr 13 20:37:50 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 293/872] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:37:52 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:37:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5" status: 204 len: 0 microversion: 2.1 time: 0.126702 Apr 13 20:37:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 291/873] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:37:52 2023] DELETE /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:52 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3993eb2be0d94cdbb16fd233999fc5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd550373054224fcbbb7300f512ad0345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:37:52 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-79ea9e77-1c7a-4c18-936a-0c62fa08b004 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5" status: 200 len: 1492 microversion: 2.1 time: 0.204425 Apr 13 20:37:52 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 290/874] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:37:52 2023] GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5 => generated 1492 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:37:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4eb9e9-983d-4009-8e32-56a4494961c5", "name": "network-vif-unplugged", "status": "completed", "tag": "7f1026a7-0645-4eae-8338-5275284ecf2e"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] Creating event network-vif-unplugged:7f1026a7-0645-4eae-8338-5275284ecf2e for instance ea4eb9e9-983d-4009-8e32-56a4494961c5 on user Apr 13 20:37:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030438 Apr 13 20:37:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 294/875] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:37:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4eb9e9-983d-4009-8e32-56a4494961c5", "name": "network-vif-plugged", "status": "completed", "tag": "7f1026a7-0645-4eae-8338-5275284ecf2e"}, {"server_uuid": "ea4eb9e9-983d-4009-8e32-56a4494961c5", "name": "network-vif-deleted", "tag": "7f1026a7-0645-4eae-8338-5275284ecf2e"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:37:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:37:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:37:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:37:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Creating event network-vif-plugged:7f1026a7-0645-4eae-8338-5275284ecf2e for instance ea4eb9e9-983d-4009-8e32-56a4494961c5 on user Apr 13 20:37:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Creating event network-vif-deleted:7f1026a7-0645-4eae-8338-5275284ecf2e for instance ea4eb9e9-983d-4009-8e32-56a4494961c5 on user Apr 13 20:37:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031228 Apr 13 20:37:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 292/876] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:37:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:01 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1995711390"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:01 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:01 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:01 user devstack@n-api.service[61655]: INFO nova.network.security_group_api [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Removing security group 2c2324b9-af28-4036-aeb4-39883423e671 from port 8e8101de-d339-437b-b94c-e40a63e6e6aa Apr 13 20:38:01 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-f5a52d62-d256-42e1-94d8-d203e5440a2a tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "POST /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/action" status: 202 len: 0 microversion: 2.1 time: 0.522716 Apr 13 20:38:01 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 291/877] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:38:01 2023] POST /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:38:01 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:01 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] Creating event network-changed:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:38:01 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029958 Apr 13 20:38:01 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 295/878] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:03 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] Creating event network-changed:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:38:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032410 Apr 13 20:38:03 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 292/879] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:03 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'services' on Instance uuid 858248d1-eefa-462f-a075-078257c736e9 {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:38:03 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments/1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a" status: 202 len: 0 microversion: 2.1 time: 0.160009 Apr 13 20:38:03 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 293/880] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:38:03 2023] DELETE /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments/1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:38:03 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:03 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:03 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c9656cb8-deb4-4ea0-bd25-c9f42c8e4722 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048028 Apr 13 20:38:03 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 296/881] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:38:03 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:10 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f HTTP/1.1 Apr 13 20:38:10 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:38:10 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:38:10 user devstack@n-api.service[61655]: Connection: close Apr 13 20:38:10 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:38:10 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:38:10 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:38:10 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:38:10 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:10 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:10 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:10 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:38:10 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:38:10 user devstack@n-api.service[61655]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:10 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:10 user devstack@n-api.service[61655]: method: > Apr 13 20:38:10 user devstack@n-api.service[61655]: exception: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:10 user devstack@n-api.service[61655]: action_args: {'id': '0bdf333a-456b-413b-92d6-87e45474905f'} Apr 13 20:38:10 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:10 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-223241ab-cfd5-4333-8857-d225c2d6e68b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f" status: 404 len: 111 microversion: 2.1 time: 0.033585 Apr 13 20:38:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 293/882] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:10 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:10 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-29937fbb-5051-4f98-bfbe-437db60be560 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '.version_select at 0x7f7833df3b50>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:10 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-29937fbb-5051-4f98-bfbe-437db60be560 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660813888" status: 202 len: 0 microversion: 2.1 time: 0.023666 Apr 13 20:38:10 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 294/883] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 20:38:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660813888 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=7 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=11 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:13 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f HTTP/1.1 Apr 13 20:38:13 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:38:13 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:38:13 user devstack@n-api.service[61653]: Connection: close Apr 13 20:38:13 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:38:13 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:38:13 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:38:13 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:38:13 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:13 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:13 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:13 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:38:13 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:38:13 user devstack@n-api.service[61653]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:13 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:13 user devstack@n-api.service[61653]: method: > Apr 13 20:38:13 user devstack@n-api.service[61653]: exception: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61653]: action_args: {'id': '0bdf333a-456b-413b-92d6-87e45474905f'} Apr 13 20:38:13 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b0ea5fcd-3479-4331-8a59-a6ef4065f1e8 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f" status: 404 len: 111 microversion: 2.1 time: 0.032759 Apr 13 20:38:13 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 297/884] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:38:13 2023] DELETE /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:13 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f HTTP/1.1 Apr 13 20:38:13 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:38:13 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:38:13 user devstack@n-api.service[61655]: Connection: close Apr 13 20:38:13 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:38:13 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:38:13 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:38:13 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:38:13 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:13 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:13 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:13 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:38:13 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:38:13 user devstack@n-api.service[61655]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:13 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:13 user devstack@n-api.service[61655]: method: > Apr 13 20:38:13 user devstack@n-api.service[61655]: exception: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61655]: action_args: {'id': '0bdf333a-456b-413b-92d6-87e45474905f'} Apr 13 20:38:13 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. Apr 13 20:38:13 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 0bdf333a-456b-413b-92d6-87e45474905f could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c969a14f-ff64-43da-a8c0-8fb767108ecd tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f" status: 404 len: 111 microversion: 2.1 time: 0.029399 Apr 13 20:38:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 294/885] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:13 2023] GET /compute/v2.1/servers/0bdf333a-456b-413b-92d6-87e45474905f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:15 user devstack@n-api.service[61654]: request: DELETE /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 HTTP/1.1 Apr 13 20:38:15 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:38:15 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:38:15 user devstack@n-api.service[61654]: Connection: close Apr 13 20:38:15 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:38:15 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:38:15 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:38:15 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:38:15 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:15 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:15 user devstack@n-api.service[61654]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:15 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:38:15 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:38:15 user devstack@n-api.service[61654]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:15 user devstack@n-api.service[61654]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:15 user devstack@n-api.service[61654]: method: > Apr 13 20:38:15 user devstack@n-api.service[61654]: exception: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:15 user devstack@n-api.service[61654]: action_args: {'id': '8acd3c03-8835-4b69-aabd-7a5a34b910d5'} Apr 13 20:38:15 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:15 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:15 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-b4c4f137-1c33-487c-b9c2-25b62a8e1320 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5" status: 404 len: 111 microversion: 2.1 time: 0.044693 Apr 13 20:38:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 295/886] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:38:15 2023] DELETE /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:16 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 HTTP/1.1 Apr 13 20:38:16 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:38:16 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:38:16 user devstack@n-api.service[61653]: Connection: close Apr 13 20:38:16 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:38:16 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:38:16 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:38:16 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:38:16 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:16 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:16 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:38:16 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:38:16 user devstack@n-api.service[61653]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:16 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:16 user devstack@n-api.service[61653]: method: > Apr 13 20:38:16 user devstack@n-api.service[61653]: exception: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:16 user devstack@n-api.service[61653]: action_args: {'id': '8acd3c03-8835-4b69-aabd-7a5a34b910d5'} Apr 13 20:38:16 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. Apr 13 20:38:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0798ea13-766b-480a-846c-ce521e71c0ac tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5" status: 404 len: 111 microversion: 2.1 time: 0.036680 Apr 13 20:38:16 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 298/887] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:15 2023] GET /compute/v2.1/servers/8acd3c03-8835-4b69-aabd-7a5a34b910d5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:16 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e HTTP/1.1 Apr 13 20:38:16 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:38:16 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:38:16 user devstack@n-api.service[61655]: Connection: close Apr 13 20:38:16 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:38:16 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:38:16 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:38:16 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:38:16 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:16 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:16 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:38:16 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:38:16 user devstack@n-api.service[61655]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:16 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:16 user devstack@n-api.service[61655]: method: > Apr 13 20:38:16 user devstack@n-api.service[61655]: exception: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61655]: action_args: {'id': '24a4358f-82a4-408d-8206-49f05579b45e'} Apr 13 20:38:16 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b394a51f-8a03-463a-99f1-4bd0d2ff24cf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e" status: 404 len: 111 microversion: 2.1 time: 0.028583 Apr 13 20:38:16 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 295/888] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:38:16 2023] DELETE /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:16 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:16 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e HTTP/1.1 Apr 13 20:38:16 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:38:16 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:38:16 user devstack@n-api.service[61654]: Connection: close Apr 13 20:38:16 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:38:16 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:38:16 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:38:16 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:38:16 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:16 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:16 user devstack@n-api.service[61654]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:16 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:38:16 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:38:16 user devstack@n-api.service[61654]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:16 user devstack@n-api.service[61654]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:16 user devstack@n-api.service[61654]: method: > Apr 13 20:38:16 user devstack@n-api.service[61654]: exception: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61654]: action_args: {'id': '24a4358f-82a4-408d-8206-49f05579b45e'} Apr 13 20:38:16 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. Apr 13 20:38:16 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:16 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-755987d0-f764-418a-938a-1477d8ad6c07 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e" status: 404 len: 111 microversion: 2.1 time: 0.029619 Apr 13 20:38:16 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 296/889] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:16 2023] GET /compute/v2.1/servers/24a4358f-82a4-408d-8206-49f05579b45e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:19 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b HTTP/1.1 Apr 13 20:38:19 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:38:19 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:38:19 user devstack@n-api.service[61653]: Connection: close Apr 13 20:38:19 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:38:19 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:38:19 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:38:19 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:38:19 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:19 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:19 user devstack@n-api.service[61653]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:19 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:38:19 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:38:19 user devstack@n-api.service[61653]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:19 user devstack@n-api.service[61653]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:19 user devstack@n-api.service[61653]: method: > Apr 13 20:38:19 user devstack@n-api.service[61653]: exception: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61653]: action_args: {'id': 'a369e185-3d75-4dde-8e8a-0e397aab892b'} Apr 13 20:38:19 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-e8105408-bb7f-498e-94b9-b5865a8fdad0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b" status: 404 len: 111 microversion: 2.1 time: 0.028317 Apr 13 20:38:19 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 299/890] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:38:19 2023] DELETE /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=17 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=29 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HTTP exception thrown: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Request method failure captured: Apr 13 20:38:19 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b HTTP/1.1 Apr 13 20:38:19 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:38:19 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:38:19 user devstack@n-api.service[61655]: Connection: close Apr 13 20:38:19 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:38:19 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:38:19 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:38:19 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:38:19 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTlH9B3Ld7TDaUC0fFy_MVaA9iibHrIT5VvRaJsbkRYr0dq0dxfzrenmTHMkpwPMtXNOLX7uYJU2gH1lM5fkfYKvBoXpB944tPHfink_oZOGSdVfATeDJlAMl_S6aVfwLrKdphZDJxXFv_lwtTYE76rPs3x1-LSmanyqlqjomKwhc4 Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Project-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Project-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/053f656470d94d2a9140f393bad01000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/053f656470d94d2a9140f393bad01000"}]}] Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Tenant: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Tenant-Id: 053f656470d94d2a9140f393bad01000 Apr 13 20:38:19 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1371087403 Apr 13 20:38:19 user devstack@n-api.service[61655]: X-User: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:19 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:38:19 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:38:19 user devstack@n-api.service[61655]: X-User-Id: 49383d6f0e7141548370d8bc3b96dfd9 Apr 13 20:38:19 user devstack@n-api.service[61655]: X-User-Name: tempest-AttachVolumeNegativeTest-1371087403-project-member Apr 13 20:38:19 user devstack@n-api.service[61655]: method: > Apr 13 20:38:19 user devstack@n-api.service[61655]: exception: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61655]: action_args: {'id': 'a369e185-3d75-4dde-8e8a-0e397aab892b'} Apr 13 20:38:19 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. Apr 13 20:38:19 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:19 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Returning 404 to user: Instance a369e185-3d75-4dde-8e8a-0e397aab892b could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-805303c0-200b-4da5-8e35-e9c7f43a9395 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b" status: 404 len: 111 microversion: 2.1 time: 0.035563 Apr 13 20:38:19 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 296/891] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:19 2023] GET /compute/v2.1/servers/a369e185-3d75-4dde-8e8a-0e397aab892b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:20 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:38:20 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-db188383-66ce-4be6-b7a5-8c26fd51cf49 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444" status: 200 len: 1443 microversion: 2.1 time: 0.177983 Apr 13 20:38:20 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 297/892] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:20 2023] GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:22 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:38:22 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 HTTP/1.1 Apr 13 20:38:22 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:38:22 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:38:22 user devstack@n-api.service[61653]: Connection: close Apr 13 20:38:22 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:38:22 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:38:22 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:38:22 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:38:22 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:38:22 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61653]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:38:22 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:38:22 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:38:22 user devstack@n-api.service[61653]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:38:22 user devstack@n-api.service[61653]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:38:22 user devstack@n-api.service[61653]: method: > Apr 13 20:38:22 user devstack@n-api.service[61653]: exception: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61653]: action_args: {'id': 'b8bcf189-a781-474e-bc4f-8a471a661e93'} Apr 13 20:38:22 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:22 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b2f97317-e413-4d32-a64f-6c89808dfd22 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 404 len: 111 microversion: 2.1 time: 0.027935 Apr 13 20:38:22 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 300/893] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:22 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:22 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:38:22 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments HTTP/1.1 Apr 13 20:38:22 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:38:22 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:38:22 user devstack@n-api.service[61655]: Connection: close Apr 13 20:38:22 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:38:22 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:38:22 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:38:22 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:38:22 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:38:22 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61655]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:38:22 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:38:22 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:38:22 user devstack@n-api.service[61655]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:38:22 user devstack@n-api.service[61655]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:38:22 user devstack@n-api.service[61655]: method: > Apr 13 20:38:22 user devstack@n-api.service[61655]: exception: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61655]: action_args: {'server_id': 'b8bcf189-a781-474e-bc4f-8a471a661e93'} Apr 13 20:38:22 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:22 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ff862eb0-e83a-4a52-b07b-ee058d77a2f1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042633 Apr 13 20:38:22 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 297/894] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:38:22 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:38:22 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 HTTP/1.1 Apr 13 20:38:22 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:38:22 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:38:22 user devstack@n-api.service[61654]: Connection: close Apr 13 20:38:22 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:38:22 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:38:22 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:38:22 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:38:22 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:38:22 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:38:22 user devstack@n-api.service[61654]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:38:22 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:38:22 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:38:22 user devstack@n-api.service[61654]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:38:22 user devstack@n-api.service[61654]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:38:22 user devstack@n-api.service[61654]: method: > Apr 13 20:38:22 user devstack@n-api.service[61654]: exception: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61654]: action_args: {'id': 'b8bcf189-a781-474e-bc4f-8a471a661e93'} Apr 13 20:38:22 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:38:22 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:22 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:22 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-f02c9a6d-3867-4135-b661-1aa91fc74d98 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 404 len: 111 microversion: 2.1 time: 0.032892 Apr 13 20:38:22 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 298/895] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:22 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2071843580", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "7ed2080d-9ecb-4275-aacd-107663b5cf3a"}], "security_groups": [{"name": "tempest-securitygroup--1585673111"}], "key_name": "tempest-keypair-514913657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:22 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] validate_networks() for [('7ed2080d-9ecb-4275-aacd-107663b5cf3a', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for user 04d351d2822a460d93748b98161d730c and project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:38:23 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:38:23 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.592909 Apr 13 20:38:23 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 301/896] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:38:22 2023] POST /compute/v2.1/servers => generated 404 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:38:23 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-bd756204-5552-41bf-baf2-3f3b64c0f394 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:23 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-bd756204-5552-41bf-baf2-3f3b64c0f394 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:23 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-bd756204-5552-41bf-baf2-3f3b64c0f394 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:38:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-bd756204-5552-41bf-baf2-3f3b64c0f394 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b" status: 200 len: 1232 microversion: 2.1 time: 0.084791 Apr 13 20:38:23 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 298/897] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:23 2023] GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b => generated 1232 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:38:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632463fb-75e1-458a-b9f7-8a19fdf7409b", "tag": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:25 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] Creating event network-changed:1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b on user Apr 13 20:38:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042727 Apr 13 20:38:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 299/898] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:27 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632463fb-75e1-458a-b9f7-8a19fdf7409b", "name": "network-vif-plugged", "status": "completed", "tag": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:27 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:27 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] Creating event network-vif-plugged:1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b on user Apr 13 20:38:27 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031866 Apr 13 20:38:27 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 302/899] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632463fb-75e1-458a-b9f7-8a19fdf7409b", "name": "network-vif-plugged", "status": "completed", "tag": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] Creating event network-vif-plugged:1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b on user Apr 13 20:38:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033029 Apr 13 20:38:29 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 299/900] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:31 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:38:31 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-fc626ff3-a6b2-4428-88a9-fca05800d440 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 200 len: 1432 microversion: 2.1 time: 0.264203 Apr 13 20:38:31 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 300/901] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:31 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 1432 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] Creating event network-changed:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:38:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037922 Apr 13 20:38:34 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 303/902] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:34 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'flavor' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:38:34 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37/action" status: 202 len: 0 microversion: 2.1 time: 0.124408 Apr 13 20:38:34 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 300/903] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:38:34 2023] POST /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:34 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:38:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-3cdd2172-4587-44b8-b581-c879ec3de668 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 200 len: 1438 microversion: 2.1 time: 0.191420 Apr 13 20:38:34 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 301/904] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:34 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 1438 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-unplugged", "status": "completed", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:34 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] Creating event network-vif-unplugged:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:38:34 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033408 Apr 13 20:38:34 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 304/905] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] Creating event network-changed:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:38:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033460 Apr 13 20:38:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 301/906] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-plugged", "status": "completed", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] Creating event network-vif-plugged:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:38:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055762 Apr 13 20:38:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 302/907] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:38 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-3da3b729-2d36-4c7b-ba2b-6a510f602a76 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052837 Apr 13 20:38:38 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 305/908] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:38:38 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:39 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:38:39 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 204 len: 0 microversion: 2.1 time: 0.155138 Apr 13 20:38:39 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 302/909] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:38:39 2023] DELETE /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:39 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-unplugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:39 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:39 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] Creating event network-vif-unplugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:38:39 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035425 Apr 13 20:38:39 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 306/910] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:39 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:38:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-7fe67331-157d-4ac2-89e4-0e6748046938 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 200 len: 1675 microversion: 2.1 time: 0.337783 Apr 13 20:38:39 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 303/911] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:39 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 1675 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:38:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-deleted", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] Creating event network-vif-deleted:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:38:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039029 Apr 13 20:38:40 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 303/912] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:38:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd729f88-fb57-4e9b-9cb8-645dcd4ae441", "name": "network-vif-plugged", "status": "completed", "tag": "09a5e612-1d46-4b74-bfaa-d5eb100ca621"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] Creating event network-vif-plugged:09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 on user Apr 13 20:38:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031200 Apr 13 20:38:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 307/913] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] HTTP exception thrown: Instance ea4eb9e9-983d-4009-8e32-56a4494961c5 could not be found. Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Request method failure captured: Apr 13 20:38:43 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5 HTTP/1.1 Apr 13 20:38:43 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:38:43 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:38:43 user devstack@n-api.service[61654]: Connection: close Apr 13 20:38:43 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:38:43 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:38:43 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:38:43 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:38:43 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGcMhA0ZBjkgVRxrirXm1IsUwWpgd5ZzCJIZpHEemdpiAEqUfnpUuJOoFnGBFhnTTydd9_M_isbx0hOk8GaTslIHPTdtJSVy0QG0gh2HWqtfc-7YlOnuK9Ku6esil4he7jxsVVUg34Qmoro2hy9rKjAZbZJtzgMaNrILCXJpNHEOHtw Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Project-Id: d550373054224fcbbb7300f512ad0345 Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesActionsTest-1802743389 Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d550373054224fcbbb7300f512ad0345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d550373054224fcbbb7300f512ad0345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d550373054224fcbbb7300f512ad0345"}]}] Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesActionsTest-1802743389 Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Tenant-Id: d550373054224fcbbb7300f512ad0345 Apr 13 20:38:43 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesActionsTest-1802743389 Apr 13 20:38:43 user devstack@n-api.service[61654]: X-User: tempest-VolumesActionsTest-1802743389-project-member Apr 13 20:38:43 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:38:43 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:38:43 user devstack@n-api.service[61654]: X-User-Id: 3993eb2be0d94cdbb16fd233999fc5c2 Apr 13 20:38:43 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesActionsTest-1802743389-project-member Apr 13 20:38:43 user devstack@n-api.service[61654]: method: > Apr 13 20:38:43 user devstack@n-api.service[61654]: exception: Instance ea4eb9e9-983d-4009-8e32-56a4494961c5 could not be found. Apr 13 20:38:43 user devstack@n-api.service[61654]: action_args: {'id': 'ea4eb9e9-983d-4009-8e32-56a4494961c5'} Apr 13 20:38:43 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4eb9e9-983d-4009-8e32-56a4494961c5 could not be found. Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4eb9e9-983d-4009-8e32-56a4494961c5 could not be found. Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4eb9e9-983d-4009-8e32-56a4494961c5 could not be found. Apr 13 20:38:43 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:38:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Returning 404 to user: Instance ea4eb9e9-983d-4009-8e32-56a4494961c5 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e39071aa-be59-47d5-a6f7-91cc56339871 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5" status: 404 len: 111 microversion: 2.1 time: 0.199387 Apr 13 20:38:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 304/914] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:42 2023] GET /compute/v2.1/servers/ea4eb9e9-983d-4009-8e32-56a4494961c5 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:53 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2d7db60c-6ba4-43a2-a6ca-99be08df6b8b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.263219 Apr 13 20:38:53 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 304/915] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:38:53 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments => generated 25 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=26 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] HTTP exception thrown: Instance 858248d1-eefa-462f-a075-078257c736e9 is not attached to volume 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Request method failure captured: Apr 13 20:38:53 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments/1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a HTTP/1.1 Apr 13 20:38:53 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:38:53 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:38:53 user devstack@n-api.service[61653]: Connection: close Apr 13 20:38:53 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:38:53 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:38:53 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:38:53 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:38:53 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGXT8P3Pc1LLQPf6QUkD3NTw-0n8CpWOFCKgqUHRWdIcJ3HztGH1wBeB8VCvpnc2zEiSJuhzHP46oDmIsVzxshPT6KP8pYmjHP3ZcmYanmUO5lOrt1VtHKFRpCX1Ry79NBrZydCWWrPdQ_LsxMIRR4pmIBgcBJnQghdsZPkTyycbcxI Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Project-Id: 41f1e999778042e2a606a2ae4072bc83 Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Project-Name: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41f1e999778042e2a606a2ae4072bc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41f1e999778042e2a606a2ae4072bc83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41f1e999778042e2a606a2ae4072bc83"}]}] Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Tenant: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Tenant-Id: 41f1e999778042e2a606a2ae4072bc83 Apr 13 20:38:53 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:38:53 user devstack@n-api.service[61653]: X-User: tempest-TestMinimumBasicScenario-1286218256-project-member Apr 13 20:38:53 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:38:53 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:38:53 user devstack@n-api.service[61653]: X-User-Id: 519afe2b763347ea889f7de8773d7de0 Apr 13 20:38:53 user devstack@n-api.service[61653]: X-User-Name: tempest-TestMinimumBasicScenario-1286218256-project-member Apr 13 20:38:53 user devstack@n-api.service[61653]: method: > Apr 13 20:38:53 user devstack@n-api.service[61653]: exception: Instance 858248d1-eefa-462f-a075-078257c736e9 is not attached to volume 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a Apr 13 20:38:53 user devstack@n-api.service[61653]: action_args: {'server_id': '858248d1-eefa-462f-a075-078257c736e9', 'id': '1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a'} Apr 13 20:38:53 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a. Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858248d1-eefa-462f-a075-078257c736e9 is not attached to volume 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858248d1-eefa-462f-a075-078257c736e9 is not attached to volume 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a Apr 13 20:38:53 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:38:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Returning 404 to user: Instance 858248d1-eefa-462f-a075-078257c736e9 is not attached to volume 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:38:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-8817307c-eea1-437a-8e39-03582534de1c tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments/1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a" status: 404 len: 154 microversion: 2.1 time: 0.152281 Apr 13 20:38:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 308/916] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:38:53 2023] DELETE /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9/os-volume_attachments/1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a => generated 154 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=11 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=36 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:57 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:38:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 204 len: 0 microversion: 2.1 time: 0.152734 Apr 13 20:38:57 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 305/917] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:38:56 2023] DELETE /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:57 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:38:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2a36eb75-3c09-463e-b929-61bb42a53c09 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 200 len: 1542 microversion: 2.1 time: 0.196229 Apr 13 20:38:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 305/918] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:38:57 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:38:57 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-unplugged", "status": "completed", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] Creating event network-vif-unplugged:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:38:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040586 Apr 13 20:38:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 309/919] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:59 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-deleted", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:59 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] Creating event network-vif-deleted:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:38:59 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035810 Apr 13 20:38:59 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 306/920] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:38:59 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858248d1-eefa-462f-a075-078257c736e9", "name": "network-vif-plugged", "status": "completed", "tag": "8e8101de-d339-437b-b94c-e40a63e6e6aa"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:38:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:38:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:38:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:38:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] Creating event network-vif-plugged:8e8101de-d339-437b-b94c-e40a63e6e6aa for instance 858248d1-eefa-462f-a075-078257c736e9 on user Apr 13 20:38:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093596 Apr 13 20:38:59 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 306/921] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:38:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:13 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:39:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1b36db6c-fe5e-4ab1-a781-ee46a7cb88ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b" status: 200 len: 1540 microversion: 2.1 time: 0.196016 Apr 13 20:39:13 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 310/922] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:39:13 2023] GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b => generated 1540 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:39:20 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:20 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:21 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:39:21 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2495d965-1feb-4d91-9719-c39d962788de tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444" status: 200 len: 1443 microversion: 2.1 time: 0.555109 Apr 13 20:39:21 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 307/923] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:39:20 2023] GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 => generated 1443 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:39:23 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:23 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=14 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:23 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c4d5801-3b71-4ce3-83b9-9bf54507c444", "tag": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] Creating event network-changed:9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 on user Apr 13 20:39:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039555 Apr 13 20:39:23 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 307/924] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:39:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:23 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:39:23 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444" status: 204 len: 0 microversion: 2.1 time: 0.124326 Apr 13 20:39:23 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 311/925] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:39:23 2023] DELETE /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:23 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:39:23 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9fad1fb2-846d-4726-ab79-2de7201a18c5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444" status: 200 len: 1449 microversion: 2.1 time: 0.246186 Apr 13 20:39:23 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 308/926] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:39:23 2023] GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 => generated 1449 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:39:24 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4d5801-3b71-4ce3-83b9-9bf54507c444", "name": "network-vif-unplugged", "status": "completed", "tag": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:24 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:24 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] Creating event network-vif-unplugged:9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 on user Apr 13 20:39:24 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034553 Apr 13 20:39:24 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 308/927] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:24 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:39:24 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-40ce7121-57b7-40a9-9dd7-9a245e67bd86 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 200 len: 1498 microversion: 2.1 time: 0.197207 Apr 13 20:39:24 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 312/928] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:39:24 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:39:26 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4d5801-3b71-4ce3-83b9-9bf54507c444", "name": "network-vif-plugged", "status": "completed", "tag": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc"}, {"server_uuid": "6c4d5801-3b71-4ce3-83b9-9bf54507c444", "name": "network-vif-deleted", "tag": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Creating event network-vif-plugged:9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 on user Apr 13 20:39:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Creating event network-vif-deleted:9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 on user Apr 13 20:39:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030266 Apr 13 20:39:26 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 309/929] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:39:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] HTTP exception thrown: Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 could not be found. Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Request method failure captured: Apr 13 20:39:29 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 HTTP/1.1 Apr 13 20:39:29 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:39:29 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:39:29 user devstack@n-api.service[61655]: Connection: close Apr 13 20:39:29 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:39:29 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:39:29 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:39:29 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:39:29 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTHgU60gk6XNAecNfjeV73oUVK3OFrxGuyxBDmBdpLccBf10jTlE1CaE_8bPrOXWx15S3RgKgr1HUp5WGNhons5akLZT2gu7-Lydy2p8O9V3IRTJEtQnypqwv35JAR3FcpsnAbcjx6JdBEO9GPBYvn3J-f139TWaVCNjyaFWyVSeZU Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Project-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}] Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Tenant-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:39:29 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:39:29 user devstack@n-api.service[61655]: X-User: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:39:29 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:39:29 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:39:29 user devstack@n-api.service[61655]: X-User-Id: c89de9f7e5014fa8b0ff7b808bedfb91 Apr 13 20:39:29 user devstack@n-api.service[61655]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:39:29 user devstack@n-api.service[61655]: method: > Apr 13 20:39:29 user devstack@n-api.service[61655]: exception: Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 could not be found. Apr 13 20:39:29 user devstack@n-api.service[61655]: action_args: {'id': 'fd729f88-fb57-4e9b-9cb8-645dcd4ae441'} Apr 13 20:39:29 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 could not be found. Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 could not be found. Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 could not be found. Apr 13 20:39:29 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:39:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Returning 404 to user: Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:39:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-753fc497-6d4d-4e61-a0a9-8d5f68573be0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441" status: 404 len: 111 microversion: 2.1 time: 0.034573 Apr 13 20:39:29 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 309/930] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:39:29 2023] GET /compute/v2.1/servers/fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:39:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-21c03579-8245-40bb-b804-4a6f018e0b9f tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '.version_select at 0x7f7833d8bc70>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:29 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-21c03579-8245-40bb-b804-4a6f018e0b9f tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768981879" status: 202 len: 0 microversion: 2.1 time: 0.023388 Apr 13 20:39:29 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 313/931] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 20:39:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768981879 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=14 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:37 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:39:37 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58" status: 204 len: 0 microversion: 2.1 time: 0.146711 Apr 13 20:39:37 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 310/932] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:39:37 2023] DELETE /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:39:37 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:37 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:37 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:37 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:39:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-unplugged", "status": "completed", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] Creating event network-vif-unplugged:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:39:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107927 Apr 13 20:39:38 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 314/933] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:39:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:38 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:39:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-58833ba8-6c0f-4b1e-8232-e50bf3cf1137 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58" status: 200 len: 1497 microversion: 2.1 time: 0.587788 Apr 13 20:39:38 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 310/934] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:39:37 2023] GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58 => generated 1497 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2052775286", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "f480708b-bb2a-4e79-9d65-e09ce39d0c41"}]}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] validate_networks() for [('f480708b-bb2a-4e79-9d65-e09ce39d0c41', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting quotas for project 0a8f583cda274b8ba1e6383d1aa142d7. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting quotas for user 24880a07e48f4125b4a63048c6f5237b and project 0a8f583cda274b8ba1e6383d1aa142d7. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:39:39 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:39:39 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.588006 Apr 13 20:39:39 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 311/935] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:39:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:39:39 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e408f14e-9c3c-41d9-bb50-a57643870665 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:39 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e408f14e-9c3c-41d9-bb50-a57643870665 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:39 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-e408f14e-9c3c-41d9-bb50-a57643870665 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24880a07e48f4125b4a63048c6f5237b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8f583cda274b8ba1e6383d1aa142d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:39:39 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-e408f14e-9c3c-41d9-bb50-a57643870665 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933" status: 200 len: 1213 microversion: 2.1 time: 0.132741 Apr 13 20:39:39 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 315/936] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:39:39 2023] GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:39:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-plugged", "status": "completed", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}, {"server_uuid": "65b84d48-a188-45d4-8720-4036faeaca58", "name": "network-vif-deleted", "tag": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Creating event network-vif-plugged:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:39:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Creating event network-vif-deleted:ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance 65b84d48-a188-45d4-8720-4036faeaca58 on user Apr 13 20:39:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039625 Apr 13 20:39:40 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 311/937] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:39:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e4caf7-fdb8-4766-a8cd-4953473c3933", "tag": "f14dfe80-4160-4d1e-a21d-08d2c72ca784"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] Creating event network-changed:f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 on user Apr 13 20:39:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028753 Apr 13 20:39:42 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 312/938] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:39:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e4caf7-fdb8-4766-a8cd-4953473c3933", "name": "network-vif-plugged", "status": "completed", "tag": "f14dfe80-4160-4d1e-a21d-08d2c72ca784"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] Creating event network-vif-plugged:f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 on user Apr 13 20:39:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031609 Apr 13 20:39:44 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 316/939] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:39:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e4caf7-fdb8-4766-a8cd-4953473c3933", "name": "network-vif-plugged", "status": "completed", "tag": "f14dfe80-4160-4d1e-a21d-08d2c72ca784"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:39:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] Creating event network-vif-plugged:f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 on user Apr 13 20:39:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 Apr 13 20:39:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 312/940] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:39:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:39:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] HTTP exception thrown: Instance 858248d1-eefa-462f-a075-078257c736e9 could not be found. Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Request method failure captured: Apr 13 20:39:47 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 HTTP/1.1 Apr 13 20:39:47 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:39:47 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:39:47 user devstack@n-api.service[61654]: Connection: close Apr 13 20:39:47 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:39:47 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:39:47 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:39:47 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:39:47 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGXT8P3Pc1LLQPf6QUkD3NTw-0n8CpWOFCKgqUHRWdIcJ3HztGH1wBeB8VCvpnc2zEiSJuhzHP46oDmIsVzxshPT6KP8pYmjHP3ZcmYanmUO5lOrt1VtHKFRpCX1Ry79NBrZydCWWrPdQ_LsxMIRR4pmIBgcBJnQghdsZPkTyycbcxI Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Project-Id: 41f1e999778042e2a606a2ae4072bc83 Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41f1e999778042e2a606a2ae4072bc83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/41f1e999778042e2a606a2ae4072bc83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/41f1e999778042e2a606a2ae4072bc83"}]}] Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Tenant: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Tenant-Id: 41f1e999778042e2a606a2ae4072bc83 Apr 13 20:39:47 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1286218256 Apr 13 20:39:47 user devstack@n-api.service[61654]: X-User: tempest-TestMinimumBasicScenario-1286218256-project-member Apr 13 20:39:47 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:39:47 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:39:47 user devstack@n-api.service[61654]: X-User-Id: 519afe2b763347ea889f7de8773d7de0 Apr 13 20:39:47 user devstack@n-api.service[61654]: X-User-Name: tempest-TestMinimumBasicScenario-1286218256-project-member Apr 13 20:39:47 user devstack@n-api.service[61654]: method: > Apr 13 20:39:47 user devstack@n-api.service[61654]: exception: Instance 858248d1-eefa-462f-a075-078257c736e9 could not be found. Apr 13 20:39:47 user devstack@n-api.service[61654]: action_args: {'id': '858248d1-eefa-462f-a075-078257c736e9'} Apr 13 20:39:47 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858248d1-eefa-462f-a075-078257c736e9 could not be found. Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858248d1-eefa-462f-a075-078257c736e9 could not be found. Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858248d1-eefa-462f-a075-078257c736e9 could not be found. Apr 13 20:39:47 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:39:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Returning 404 to user: Instance 858248d1-eefa-462f-a075-078257c736e9 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:39:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-08f389b8-19ca-4381-8127-69b23592b3c2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9" status: 404 len: 111 microversion: 2.1 time: 0.048976 Apr 13 20:39:47 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 313/941] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:39:47 2023] GET /compute/v2.1/servers/858248d1-eefa-462f-a075-078257c736e9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:39:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-05674687-1f26-4655-9d46-0beeb582d118 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Calling method '.version_select at 0x7f7833def0a0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:39:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-05674687-1f26-4655-9d46-0beeb582d118 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1669926210" status: 202 len: 0 microversion: 2.1 time: 0.024091 Apr 13 20:39:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 317/942] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 20:39:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1669926210 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=12 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=16 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:13 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:13 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ad796db4-81a5-408b-b7c6-604ee4bb977c tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.310900 Apr 13 20:40:13 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 313/943] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:40:13 2023] GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b/os-interface => generated 283 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:40:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:40:14 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 HTTP/1.1 Apr 13 20:40:14 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:40:14 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:40:14 user devstack@n-api.service[61654]: Connection: close Apr 13 20:40:14 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:40:14 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:40:14 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:40:14 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:40:14 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:40:14 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:40:14 user devstack@n-api.service[61654]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:40:14 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:40:14 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:40:14 user devstack@n-api.service[61654]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:40:14 user devstack@n-api.service[61654]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:40:14 user devstack@n-api.service[61654]: method: > Apr 13 20:40:14 user devstack@n-api.service[61654]: exception: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:40:14 user devstack@n-api.service[61654]: action_args: {'id': '6c4d5801-3b71-4ce3-83b9-9bf54507c444'} Apr 13 20:40:14 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:40:14 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:40:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:40:14 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-89a229ff-534b-45da-b06d-519a92c2847b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444" status: 404 len: 111 microversion: 2.1 time: 0.042129 Apr 13 20:40:14 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 314/944] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:40:13 2023] GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1476334002", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1472807234", "security_groups": [{"name": "tempest-secgroup-smoke-1432409068"}], "block_device_mapping_v2": [{"uuid": "45e7808c-5141-44a8-bdae-b556a6b5578c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0"}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] validate_networks() for [('e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:40:14 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632463fb-75e1-458a-b9f7-8a19fdf7409b", "tag": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] Creating event network-changed:1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b on user Apr 13 20:40:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029106 Apr 13 20:40:14 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 314/945] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for user 7e478a11b57b4ee385e33c4709adf04b and project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:40:14 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45e7808c-5141-44a8-bdae-b556a6b5578c',volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:40:14 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.811760 Apr 13 20:40:14 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 318/946] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:40:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:40:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-60b59e69-3758-4210-bbba-e121db90a527 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:14 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-60b59e69-3758-4210-bbba-e121db90a527 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:15 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-60b59e69-3758-4210-bbba-e121db90a527 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:40:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-60b59e69-3758-4210-bbba-e121db90a527 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe" status: 200 len: 1090 microversion: 2.1 time: 0.061923 Apr 13 20:40:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 315/947] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:40:14 2023] GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe => generated 1090 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:40:17 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-689800020", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "7ed2080d-9ecb-4275-aacd-107663b5cf3a"}], "security_groups": [{"name": "tempest-securitygroup--1585673111"}], "key_name": "tempest-keypair-514913657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "151cb5ac-eddd-4883-ba83-7fbee0f2d350", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:17 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] Creating event network-changed:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:40:17 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035012 Apr 13 20:40:17 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 315/948] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] validate_networks() for [('7ed2080d-9ecb-4275-aacd-107663b5cf3a', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for user 04d351d2822a460d93748b98161d730c and project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:40:17 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='151cb5ac-eddd-4883-ba83-7fbee0f2d350',volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:40:18 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.716007 Apr 13 20:40:18 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 319/949] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:40:17 2023] POST /compute/v2.1/servers => generated 404 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:40:18 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-0e140d81-0b6b-4d96-8211-a4550d25bfd7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:18 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-0e140d81-0b6b-4d96-8211-a4550d25bfd7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:18 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-0e140d81-0b6b-4d96-8211-a4550d25bfd7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:40:18 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-0e140d81-0b6b-4d96-8211-a4550d25bfd7 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1074 microversion: 2.1 time: 0.065047 Apr 13 20:40:18 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 316/950] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:40:18 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1074 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:40:20 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:20 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] Creating event network-changed:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:40:20 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 Apr 13 20:40:20 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 316/951] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:23 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-plugged", "status": "completed", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:23 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:23 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] Creating event network-vif-plugged:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:40:23 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091070 Apr 13 20:40:23 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 320/952] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:24 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61654) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 20:40:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37/action" status: 202 len: 0 microversion: 2.1 time: 0.119514 Apr 13 20:40:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 317/953] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:40:24 2023] POST /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:25 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:40:25 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-f0752cbc-70e6-47c3-a3ae-f4bd9e86abc7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 200 len: 1506 microversion: 2.1 time: 0.169624 Apr 13 20:40:25 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 317/954] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:40:25 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:40:25 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-plugged", "status": "completed", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] Creating event network-vif-plugged:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:40:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055961 Apr 13 20:40:25 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 321/955] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:27 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-plugged", "status": "completed", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}, {"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-plugged", "status": "completed", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:27 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Creating event network-vif-plugged:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:40:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Creating event network-vif-plugged:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:40:27 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034730 Apr 13 20:40:27 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 318/956] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:28 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] HTTP exception thrown: Instance 65b84d48-a188-45d4-8720-4036faeaca58 could not be found. Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Request method failure captured: Apr 13 20:40:28 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58 HTTP/1.1 Apr 13 20:40:28 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:40:28 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:40:28 user devstack@n-api.service[61655]: Connection: close Apr 13 20:40:28 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:40:28 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:40:28 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:40:28 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:40:28 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTHgU60gk6XNAecNfjeV73oUVK3OFrxGuyxBDmBdpLccBf10jTlE1CaE_8bPrOXWx15S3RgKgr1HUp5WGNhons5akLZT2gu7-Lydy2p8O9V3IRTJEtQnypqwv35JAR3FcpsnAbcjx6JdBEO9GPBYvn3J-f139TWaVCNjyaFWyVSeZU Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Project-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}] Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Tenant-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:40:28 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:40:28 user devstack@n-api.service[61655]: X-User: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:40:28 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:40:28 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:40:28 user devstack@n-api.service[61655]: X-User-Id: c89de9f7e5014fa8b0ff7b808bedfb91 Apr 13 20:40:28 user devstack@n-api.service[61655]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:40:28 user devstack@n-api.service[61655]: method: > Apr 13 20:40:28 user devstack@n-api.service[61655]: exception: Instance 65b84d48-a188-45d4-8720-4036faeaca58 could not be found. Apr 13 20:40:28 user devstack@n-api.service[61655]: action_args: {'id': '65b84d48-a188-45d4-8720-4036faeaca58'} Apr 13 20:40:28 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b84d48-a188-45d4-8720-4036faeaca58 could not be found. Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b84d48-a188-45d4-8720-4036faeaca58 could not be found. Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b84d48-a188-45d4-8720-4036faeaca58 could not be found. Apr 13 20:40:28 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Returning 404 to user: Instance 65b84d48-a188-45d4-8720-4036faeaca58 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:40:28 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6e6a2f6f-9786-4b35-bd23-64fca1a6a51b tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58" status: 404 len: 111 microversion: 2.1 time: 0.135807 Apr 13 20:40:28 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 318/957] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:40:28 2023] GET /compute/v2.1/servers/65b84d48-a188-45d4-8720-4036faeaca58 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=12 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:28 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:40:28 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 204 len: 0 microversion: 2.1 time: 0.180502 Apr 13 20:40:28 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 322/958] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:40:28 2023] DELETE /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:28 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:40:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-952644ab-48f8-496b-97e8-bdbaa97aff08 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 200 len: 1510 microversion: 2.1 time: 0.200347 Apr 13 20:40:28 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 319/959] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:40:28 2023] GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-unplugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:28 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:28 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] Creating event network-vif-unplugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:40:28 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126313 Apr 13 20:40:28 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 319/960] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:29 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-94169a90-9d59-4259-85b9-9afec25418a3 req-ed25ff48-6252-4656-95bd-8269feb53e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-deleted", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-94169a90-9d59-4259-85b9-9afec25418a3 req-ed25ff48-6252-4656-95bd-8269feb53e75 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-94169a90-9d59-4259-85b9-9afec25418a3 req-ed25ff48-6252-4656-95bd-8269feb53e75 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:29 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-94169a90-9d59-4259-85b9-9afec25418a3 req-ed25ff48-6252-4656-95bd-8269feb53e75 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:29 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-94169a90-9d59-4259-85b9-9afec25418a3 req-ed25ff48-6252-4656-95bd-8269feb53e75 service nova] Creating event network-vif-deleted:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:40:29 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-94169a90-9d59-4259-85b9-9afec25418a3 req-ed25ff48-6252-4656-95bd-8269feb53e75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038314 Apr 13 20:40:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:40:29 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 323/961] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:29 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:40:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:30 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24880a07e48f4125b4a63048c6f5237b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8f583cda274b8ba1e6383d1aa142d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:40:30 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-48e01152-d34f-4f42-93d0-edb827a73506 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933" status: 200 len: 1497 microversion: 2.1 time: 0.215031 Apr 13 20:40:30 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 320/962] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:40:29 2023] GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933 => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:40:30 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d20026-e9af-4587-8930-d3dcfdb1ea3e", "name": "network-vif-plugged", "status": "completed", "tag": "374f6442-f0a3-4801-a43f-4566b1aec40b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:30 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:30 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] Creating event network-vif-plugged:374f6442-f0a3-4801-a43f-4566b1aec40b for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e on user Apr 13 20:40:30 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033525 Apr 13 20:40:30 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 320/963] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:32 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] Creating event network-changed:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:40:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040459 Apr 13 20:40:32 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 324/964] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-plugged", "status": "completed", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] Creating event network-vif-plugged:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:40:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035031 Apr 13 20:40:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 321/965] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:40:38 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-plugged", "status": "completed", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:40:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:40:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:40:38 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:40:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] Creating event network-vif-plugged:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:40:38 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033081 Apr 13 20:40:38 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 321/966] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:40:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:05 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:41:05 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-216c70af-ad6a-4279-a32a-d9fc571056e2 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe" status: 200 len: 1444 microversion: 2.1 time: 0.181135 Apr 13 20:41:05 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 325/967] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:41:05 2023] GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe => generated 1444 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:08 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:41:08 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-84638da4-3c66-4093-9520-33283d90ace4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1427 microversion: 2.1 time: 0.572526 Apr 13 20:41:08 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 322/968] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:41:08 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1427 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=18 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=24 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:15 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:41:15 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ec933850-3514-4f2c-9fb0-0933cc8c1753 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 200 len: 1551 microversion: 2.1 time: 0.151784 Apr 13 20:41:15 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 322/969] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:41:15 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] HTTP exception thrown: Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e could not be found. Apr 13 20:41:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Request method failure captured: Apr 13 20:41:19 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e HTTP/1.1 Apr 13 20:41:19 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:41:19 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:41:19 user devstack@n-api.service[61653]: Connection: close Apr 13 20:41:19 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:41:19 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:41:19 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:41:19 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:41:19 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGTHgU60gk6XNAecNfjeV73oUVK3OFrxGuyxBDmBdpLccBf10jTlE1CaE_8bPrOXWx15S3RgKgr1HUp5WGNhons5akLZT2gu7-Lydy2p8O9V3IRTJEtQnypqwv35JAR3FcpsnAbcjx6JdBEO9GPBYvn3J-f139TWaVCNjyaFWyVSeZU Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Project-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/89f747e06fa64492af3195a88e527bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/89f747e06fa64492af3195a88e527bb3"}]}] Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Tenant-Id: 89f747e06fa64492af3195a88e527bb3 Apr 13 20:41:19 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471169552 Apr 13 20:41:19 user devstack@n-api.service[61653]: X-User: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:41:19 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:41:19 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:41:19 user devstack@n-api.service[61653]: X-User-Id: c89de9f7e5014fa8b0ff7b808bedfb91 Apr 13 20:41:19 user devstack@n-api.service[61653]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471169552-project-member Apr 13 20:41:19 user devstack@n-api.service[61653]: method: > Apr 13 20:41:19 user devstack@n-api.service[61653]: exception: Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e could not be found. Apr 13 20:41:19 user devstack@n-api.service[61653]: action_args: {'id': '00d20026-e9af-4587-8930-d3dcfdb1ea3e'} Apr 13 20:41:19 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e could not be found. Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e could not be found. Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e could not be found. Apr 13 20:41:19 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:41:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Returning 404 to user: Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:41:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-fcf7dc1b-3abc-40e4-b7b8-e3babe02c0b0 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e" status: 404 len: 111 microversion: 2.1 time: 0.322110 Apr 13 20:41:19 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 326/970] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:41:18 2023] GET /compute/v2.1/servers/00d20026-e9af-4587-8930-d3dcfdb1ea3e => generated 111 bytes in 323 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e081e422-a9f1-4117-a274-b4517295659b", "device": "/dev/vdb"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:30 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:30 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "POST /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366056 Apr 13 20:41:30 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 323/971] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:41:30 2023] POST /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:51 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'services' on Instance uuid 64e4caf7-fdb8-4766-a8cd-4953473c3933 {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:41:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933/os-volume_attachments/e081e422-a9f1-4117-a274-b4517295659b" status: 202 len: 0 microversion: 2.1 time: 0.181378 Apr 13 20:41:51 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 323/972] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:41:51 2023] DELETE /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933/os-volume_attachments/e081e422-a9f1-4117-a274-b4517295659b => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:41:51 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:41:51 user devstack@n-api.service[61653]: Thu Apr 13 20:41:51 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933 (ip 10.0.0.210) !!! Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:51 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:41:51 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933" status: 204 len: 0 microversion: 2.1 time: 0.147906 Apr 13 20:41:51 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 327/973] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:41:51 2023] DELETE /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:51 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24880a07e48f4125b4a63048c6f5237b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8f583cda274b8ba1e6383d1aa142d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:41:51 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-405ad3eb-37a1-4981-a6f8-136ef90c42a8 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933" status: 200 len: 1549 microversion: 2.1 time: 0.164548 Apr 13 20:41:51 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 324/974] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:41:51 2023] GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:41:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e4caf7-fdb8-4766-a8cd-4953473c3933", "name": "network-vif-unplugged", "status": "completed", "tag": "f14dfe80-4160-4d1e-a21d-08d2c72ca784"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:41:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] Creating event network-vif-unplugged:f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 on user Apr 13 20:41:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142825 Apr 13 20:41:54 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 324/975] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:41:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:41:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-ec82656d-8af5-4b09-a3c7-0847a3413ed6 req-c63b6530-4493-4a56-a5e3-46dfd65ee2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e4caf7-fdb8-4766-a8cd-4953473c3933", "name": "network-vif-deleted", "tag": "f14dfe80-4160-4d1e-a21d-08d2c72ca784"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:41:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ec82656d-8af5-4b09-a3c7-0847a3413ed6 req-c63b6530-4493-4a56-a5e3-46dfd65ee2ab service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ec82656d-8af5-4b09-a3c7-0847a3413ed6 req-c63b6530-4493-4a56-a5e3-46dfd65ee2ab service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ec82656d-8af5-4b09-a3c7-0847a3413ed6 req-c63b6530-4493-4a56-a5e3-46dfd65ee2ab service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-ec82656d-8af5-4b09-a3c7-0847a3413ed6 req-c63b6530-4493-4a56-a5e3-46dfd65ee2ab service nova] Creating event network-vif-deleted:f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 on user Apr 13 20:41:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-ec82656d-8af5-4b09-a3c7-0847a3413ed6 req-c63b6530-4493-4a56-a5e3-46dfd65ee2ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031175 Apr 13 20:41:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 328/976] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:41:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:41:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e4caf7-fdb8-4766-a8cd-4953473c3933", "name": "network-vif-plugged", "status": "completed", "tag": "f14dfe80-4160-4d1e-a21d-08d2c72ca784"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:41:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:41:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:41:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:41:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] Creating event network-vif-plugged:f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 on user Apr 13 20:41:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 Apr 13 20:41:56 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 325/977] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:41:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:05 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:42:05 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-63869e93-db88-4746-ae3c-9a8022eb9b0d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe" status: 200 len: 1444 microversion: 2.1 time: 0.207072 Apr 13 20:42:05 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 325/978] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:42:05 2023] GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:42:07 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:07 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:07 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:07 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] Creating event network-changed:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:42:07 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034945 Apr 13 20:42:07 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 329/979] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:08 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-62923c81-0823-4e0c-bd68-6cd872cac1ab tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.146789 Apr 13 20:42:08 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 326/980] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 20:42:08 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94/os-interface => generated 282 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:10 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632463fb-75e1-458a-b9f7-8a19fdf7409b", "tag": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:10 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] Creating event network-changed:1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b on user Apr 13 20:42:10 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033138 Apr 13 20:42:10 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 326/981] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:10 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:10 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:10 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:11 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:42:11 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-cc160091-8d7c-4f8b-a460-5bf266a69b02 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1427 microversion: 2.1 time: 0.233865 Apr 13 20:42:11 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 330/982] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:42:10 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1427 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Old instance type m1.nano, new instance type m1.micro {{(pid=61654) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting quotas for user 04d351d2822a460d93748b98161d730c and project c0e9553d7d1f49f68d3b20cb647f2062. Resources: {'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:42:11 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:42:11 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94/action" status: 202 len: 0 microversion: 2.1 time: 0.307914 Apr 13 20:42:11 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 327/983] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:42:11 2023] POST /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:11 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:42:11 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-fb044f14-f0a8-47bc-8649-ac5f8b90e705 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1436 microversion: 2.1 time: 0.188628 Apr 13 20:42:11 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 327/984] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:42:11 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1436 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 20:42:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2050216643", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1472807234", "security_groups": [{"name": "tempest-secgroup-smoke-1432409068"}], "block_device_mapping_v2": [{"uuid": "c4e5885c-fb8a-417c-81e1-6946fd13af51", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0"}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:13 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:13 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:13 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Creating event network-changed:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] validate_networks() for [('e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:42:13 user devstack@n-api.service[61654]: DEBUG nova.compute.api [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Instance 99cad31b-84d7-4b5b-b932-747848852c94 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61654) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:42:13 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037848 Apr 13 20:42:13 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 328/985] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting quotas for user 7e478a11b57b4ee385e33c4709adf04b and project 65dc7126add94e0c97afbe225c8447a4. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:42:13 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4e5885c-fb8a-417c-81e1-6946fd13af51',volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:42:14 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.449340 Apr 13 20:42:14 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 331/986] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:42:12 2023] POST /compute/v2.1/servers => generated 404 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:42:14 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6b69e9a7-d870-41f8-906b-56dbcbe3dbcb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:14 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-6b69e9a7-d870-41f8-906b-56dbcbe3dbcb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:14 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-6b69e9a7-d870-41f8-906b-56dbcbe3dbcb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:42:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6b69e9a7-d870-41f8-906b-56dbcbe3dbcb tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c" status: 200 len: 1090 microversion: 2.1 time: 0.135312 Apr 13 20:42:14 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 328/987] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:42:14 2023] GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c => generated 1090 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:42:15 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-unplugged", "status": "completed", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}, {"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-plugged", "status": "completed", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:15 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Creating event network-vif-unplugged:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:42:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Creating event network-vif-plugged:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:42:15 user devstack@n-api.service[61654]: DEBUG nova.compute.api [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Instance 99cad31b-84d7-4b5b-b932-747848852c94 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61654) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:42:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045074 Apr 13 20:42:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 329/988] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:15 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:15 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-087b226f-05d9-4ec2-b4c5-8387b8032783 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Action: 'create', calling method: .version_select at 0x7f7833e9c940>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1395940804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhOXBhf1EREMfWw7824K/m7ZWHva0Ib5kxoZBf1y/rD1+0w3EsV+DCuV1OLOfRq+SzB9mv575SLDbT1jgnsX+C2g9/ev6CIwZ+Gjd/H3yMnneQrMldzCHPrXL8Xq9ML6w=="}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:15 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-087b226f-05d9-4ec2-b4c5-8387b8032783 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting quotas for project 078e29f3a0914d2492f7ff5ac6083859. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:42:15 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-087b226f-05d9-4ec2-b4c5-8387b8032783 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting quotas for user d37c755040ea402f96618b587efb5dca and project 078e29f3a0914d2492f7ff5ac6083859. Resources: {'key_pairs'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:42:15 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-087b226f-05d9-4ec2-b4c5-8387b8032783 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.202009 Apr 13 20:42:15 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 332/989] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 20:42:15 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:16 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:42:16 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 204 len: 0 microversion: 2.1 time: 0.123328 Apr 13 20:42:16 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 329/990] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:42:16 2023] DELETE /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:16 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:42:16 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-8f3edf75-782a-4066-be3f-15ed5a6a07e3 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 200 len: 1557 microversion: 2.1 time: 0.215405 Apr 13 20:42:16 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 330/991] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:42:16 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:42:17 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-unplugged", "status": "completed", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:17 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:17 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] Creating event network-vif-unplugged:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:42:17 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057438 Apr 13 20:42:17 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 333/992] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:17 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:17 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:17 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] Creating event network-changed:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:42:17 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030036 Apr 13 20:42:17 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 330/993] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:17 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1608632534", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1395940804", "security_groups": [{"name": "tempest-secgroup-smoke-95545709"}], "networks": [{"uuid": "2b2871d3-a109-479e-89b1-8c8528fb7c37"}]}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:18 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] validate_networks() for [('2b2871d3-a109-479e-89b1-8c8528fb7c37', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:42:18 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-ab2da4a4-eb83-4419-bf89-d4f94ef33bab req-042162e5-6de4-441f-aac3-bc4a1e30cd96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-deleted", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ab2da4a4-eb83-4419-bf89-d4f94ef33bab req-042162e5-6de4-441f-aac3-bc4a1e30cd96 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ab2da4a4-eb83-4419-bf89-d4f94ef33bab req-042162e5-6de4-441f-aac3-bc4a1e30cd96 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:18 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ab2da4a4-eb83-4419-bf89-d4f94ef33bab req-042162e5-6de4-441f-aac3-bc4a1e30cd96 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:18 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-ab2da4a4-eb83-4419-bf89-d4f94ef33bab req-042162e5-6de4-441f-aac3-bc4a1e30cd96 service nova] Creating event network-vif-deleted:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:42:18 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-ab2da4a4-eb83-4419-bf89-d4f94ef33bab req-042162e5-6de4-441f-aac3-bc4a1e30cd96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059828 Apr 13 20:42:18 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 334/994] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting quotas for project 078e29f3a0914d2492f7ff5ac6083859. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting quotas for user d37c755040ea402f96618b587efb5dca and project 078e29f3a0914d2492f7ff5ac6083859. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:42:19 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c6ae32-1e90-4151-b5fe-465e3729a65c", "tag": "9f8191a8-df0e-4838-8422-5a5e85302e9b"}, {"server_uuid": "4bb153e2-7b64-4495-8b9d-24be34497c37", "name": "network-vif-plugged", "status": "completed", "tag": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:42:19 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:42:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:19 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Creating event network-changed:9f8191a8-df0e-4838-8422-5a5e85302e9b for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c on user Apr 13 20:42:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Creating event network-vif-plugged:aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance 4bb153e2-7b64-4495-8b9d-24be34497c37 on user Apr 13 20:42:19 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036826 Apr 13 20:42:19 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 331/995] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:19 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:19 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.238600 Apr 13 20:42:19 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 331/996] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:42:17 2023] POST /compute/v2.1/servers => generated 402 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:42:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-df23c2ab-eebf-4e8c-97d3-7a9fcb2a7265 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:19 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-df23c2ab-eebf-4e8c-97d3-7a9fcb2a7265 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:19 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-df23c2ab-eebf-4e8c-97d3-7a9fcb2a7265 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37c755040ea402f96618b587efb5dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078e29f3a0914d2492f7ff5ac6083859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:42:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-df23c2ab-eebf-4e8c-97d3-7a9fcb2a7265 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c" status: 200 len: 1257 microversion: 2.1 time: 0.076362 Apr 13 20:42:19 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 335/997] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:42:19 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c => generated 1257 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:42:22 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38831b52-4793-489b-87ea-3bbad883758c", "tag": "0b225740-55dc-4bb0-be66-3c40b7a25e61"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:22 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] Creating event network-changed:0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance 38831b52-4793-489b-87ea-3bbad883758c on user Apr 13 20:42:22 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035019 Apr 13 20:42:22 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 332/998] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:24 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c6ae32-1e90-4151-b5fe-465e3729a65c", "name": "network-vif-plugged", "status": "completed", "tag": "9f8191a8-df0e-4838-8422-5a5e85302e9b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] Creating event network-vif-plugged:9f8191a8-df0e-4838-8422-5a5e85302e9b for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c on user Apr 13 20:42:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047189 Apr 13 20:42:24 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 332/999] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38831b52-4793-489b-87ea-3bbad883758c", "name": "network-vif-plugged", "status": "completed", "tag": "0b225740-55dc-4bb0-be66-3c40b7a25e61"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:24 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:24 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:24 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] Creating event network-vif-plugged:0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance 38831b52-4793-489b-87ea-3bbad883758c on user Apr 13 20:42:24 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061486 Apr 13 20:42:24 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 336/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:26 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c6ae32-1e90-4151-b5fe-465e3729a65c", "name": "network-vif-plugged", "status": "completed", "tag": "9f8191a8-df0e-4838-8422-5a5e85302e9b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] Creating event network-vif-plugged:9f8191a8-df0e-4838-8422-5a5e85302e9b for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c on user Apr 13 20:42:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062027 Apr 13 20:42:26 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 333/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:26 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38831b52-4793-489b-87ea-3bbad883758c", "name": "network-vif-plugged", "status": "completed", "tag": "0b225740-55dc-4bb0-be66-3c40b7a25e61"}, {"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-plugged", "status": "completed", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}, {"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-plugged", "status": "completed", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Creating event network-vif-plugged:0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance 38831b52-4793-489b-87ea-3bbad883758c on user Apr 13 20:42:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Creating event network-vif-plugged:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:42:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Creating event network-vif-plugged:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:42:26 user devstack@n-api.service[61654]: DEBUG nova.compute.api [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Instance 99cad31b-84d7-4b5b-b932-747848852c94 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61654) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 20:42:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042474 Apr 13 20:42:26 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 333/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:26 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=12 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=16 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] HTTP exception thrown: Instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 could not be found. Apr 13 20:42:42 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Request method failure captured: Apr 13 20:42:42 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933 HTTP/1.1 Apr 13 20:42:42 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:42:42 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:42:42 user devstack@n-api.service[61653]: Connection: close Apr 13 20:42:42 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:42:42 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:42:42 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:42:42 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:42:42 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGiEaRWDy0DrY6gZYP1Rdh0QxfjVo99ULplb1LmL0pUSyLhoSceYE_qCmJjJQ0FgsFi2rICuC3XCFlyOMWBgi677IvoMOyA7oHVEQgJ96ztxcmEFr3D8tFk-UphIwiJ7t_6zgyoy9ZbdNl9DSCUvmrvs_Z4Xp6JzpzicSJV94Kv_uAI Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Project-Id: 0a8f583cda274b8ba1e6383d1aa142d7 Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2146034860 Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a8f583cda274b8ba1e6383d1aa142d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a8f583cda274b8ba1e6383d1aa142d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a8f583cda274b8ba1e6383d1aa142d7"}]}] Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Tenant: tempest-VolumesSnapshotTestJSON-2146034860 Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Tenant-Id: 0a8f583cda274b8ba1e6383d1aa142d7 Apr 13 20:42:42 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2146034860 Apr 13 20:42:42 user devstack@n-api.service[61653]: X-User: tempest-VolumesSnapshotTestJSON-2146034860-project-member Apr 13 20:42:42 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:42:42 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:42:42 user devstack@n-api.service[61653]: X-User-Id: 24880a07e48f4125b4a63048c6f5237b Apr 13 20:42:42 user devstack@n-api.service[61653]: X-User-Name: tempest-VolumesSnapshotTestJSON-2146034860-project-member Apr 13 20:42:42 user devstack@n-api.service[61653]: method: > Apr 13 20:42:42 user devstack@n-api.service[61653]: exception: Instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 could not be found. Apr 13 20:42:42 user devstack@n-api.service[61653]: action_args: {'id': '64e4caf7-fdb8-4766-a8cd-4953473c3933'} Apr 13 20:42:42 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 could not be found. Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 could not be found. Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 could not be found. Apr 13 20:42:42 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:42:42 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Returning 404 to user: Instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:42:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-ccc1c4e4-cbc6-46c4-8f37-c82fe1d904d4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933" status: 404 len: 111 microversion: 2.1 time: 0.048069 Apr 13 20:42:42 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 337/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:42:41 2023] GET /compute/v2.1/servers/64e4caf7-fdb8-4766-a8cd-4953473c3933 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-530196953", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "f480708b-bb2a-4e79-9d65-e09ce39d0c41"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] validate_networks() for [('f480708b-bb2a-4e79-9d65-e09ce39d0c41', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting quotas for project 0a8f583cda274b8ba1e6383d1aa142d7. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting quotas for user 24880a07e48f4125b4a63048c6f5237b and project 0a8f583cda274b8ba1e6383d1aa142d7. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:42:51 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:42:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.576423 Apr 13 20:42:51 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 334/1004] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 20:42:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 20:42:51 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=5 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:51 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:51 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:51 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:51 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ea779d2e-a93d-49dc-a469-172696ade54e tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:42:51 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ea779d2e-a93d-49dc-a469-172696ade54e tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:42:51 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ea779d2e-a93d-49dc-a469-172696ade54e tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24880a07e48f4125b4a63048c6f5237b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8f583cda274b8ba1e6383d1aa142d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:42:51 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ea779d2e-a93d-49dc-a469-172696ade54e tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851" status: 200 len: 1212 microversion: 2.1 time: 0.082781 Apr 13 20:42:51 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 334/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:42:51 2023] GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:42:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0865046e-7479-409c-9105-f202b4629851", "tag": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:54 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:54 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:42:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] Creating event network-changed:b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance 0865046e-7479-409c-9105-f202b4629851 on user Apr 13 20:42:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037956 Apr 13 20:42:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 338/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:42:56 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0865046e-7479-409c-9105-f202b4629851", "name": "network-vif-plugged", "status": "completed", "tag": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:56 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] Creating event network-vif-plugged:b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance 0865046e-7479-409c-9105-f202b4629851 on user Apr 13 20:42:56 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036557 Apr 13 20:42:56 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 335/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:42:58 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0865046e-7479-409c-9105-f202b4629851", "name": "network-vif-plugged", "status": "completed", "tag": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:42:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:42:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:42:58 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:42:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] Creating event network-vif-plugged:b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance 0865046e-7479-409c-9105-f202b4629851 on user Apr 13 20:42:58 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 Apr 13 20:42:58 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 335/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:42:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:01 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:43:01 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-48b340bf-d5f5-424e-b54d-b230533da7e5 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1553 microversion: 2.1 time: 0.164870 Apr 13 20:43:01 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 339/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:43:01 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:04 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:43:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-75f21c9f-2569-4569-afa1-1dca16d8e83a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c" status: 200 len: 1443 microversion: 2.1 time: 0.176376 Apr 13 20:43:04 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 336/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:43:04 2023] GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c => generated 1443 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] HTTP exception thrown: Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 could not be found. Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Request method failure captured: Apr 13 20:43:06 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 HTTP/1.1 Apr 13 20:43:06 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:43:06 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:43:06 user devstack@n-api.service[61654]: Connection: close Apr 13 20:43:06 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:43:06 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:43:06 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:43:06 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:43:06 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGfLbT4-8ag9oD-ffo6duaeFA6ZCTSvL6Wvqv5PMH2IByUp3tZi9npN48JyIMYgnDf7eQ7clL00mV27mFL4xl1GK20LNN2RupA8vId1W4JhpQC9_sTys6yarF8LBAieh4mEYsGs54jzyS_o46iyl_s5NxlKZEtNk1UAHMe7Rx2hS_MM Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Project-Id: e0749bcd26454f179454d9f9cacbfbdb Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestShelveInstance-1339516766 Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0749bcd26454f179454d9f9cacbfbdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e0749bcd26454f179454d9f9cacbfbdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0749bcd26454f179454d9f9cacbfbdb"}]}] Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Tenant: tempest-TestShelveInstance-1339516766 Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Tenant-Id: e0749bcd26454f179454d9f9cacbfbdb Apr 13 20:43:06 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestShelveInstance-1339516766 Apr 13 20:43:06 user devstack@n-api.service[61654]: X-User: tempest-TestShelveInstance-1339516766-project-member Apr 13 20:43:06 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:43:06 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:43:06 user devstack@n-api.service[61654]: X-User-Id: 99bfa0ed895e4574a3e0532e588ca74a Apr 13 20:43:06 user devstack@n-api.service[61654]: X-User-Name: tempest-TestShelveInstance-1339516766-project-member Apr 13 20:43:06 user devstack@n-api.service[61654]: method: > Apr 13 20:43:06 user devstack@n-api.service[61654]: exception: Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 could not be found. Apr 13 20:43:06 user devstack@n-api.service[61654]: action_args: {'id': '4bb153e2-7b64-4495-8b9d-24be34497c37'} Apr 13 20:43:06 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 could not be found. Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 could not be found. Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 could not be found. Apr 13 20:43:06 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:43:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Returning 404 to user: Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:43:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d39a1f08-ccf8-4e90-96a5-192031025559 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37" status: 404 len: 111 microversion: 2.1 time: 0.032961 Apr 13 20:43:06 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 336/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:43:06 2023] GET /compute/v2.1/servers/4bb153e2-7b64-4495-8b9d-24be34497c37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:43:07 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2e0fcf35-efaf-4e73-82fb-80469a4a2765 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Calling method '.version_select at 0x7f7833e9d990>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:43:07 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2e0fcf35-efaf-4e73-82fb-80469a4a2765 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-455469676" status: 202 len: 0 microversion: 2.1 time: 0.023371 Apr 13 20:43:07 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 340/1012] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 20:43:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-455469676 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:09 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37c755040ea402f96618b587efb5dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078e29f3a0914d2492f7ff5ac6083859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:43:09 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-179b9809-ccdf-48be-9161-d61293019c0d tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c" status: 200 len: 1567 microversion: 2.1 time: 0.210301 Apr 13 20:43:09 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 337/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:43:09 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:43:42 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24880a07e48f4125b4a63048c6f5237b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8f583cda274b8ba1e6383d1aa142d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:43:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-8a42089a-29cf-413e-8832-994b47b1e8be tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851" status: 200 len: 1496 microversion: 2.1 time: 0.171121 Apr 13 20:43:42 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 337/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:43:42 2023] GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851 => generated 1496 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:01 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:02 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94/action" status: 204 len: 0 microversion: 2.1 time: 0.079733 Apr 13 20:44:02 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 341/1015] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:44:01 2023] POST /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=16 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:02 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:44:02 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-43eed0b7-6f98-417e-a29e-626f631f0373 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1553 microversion: 2.1 time: 0.172164 Apr 13 20:44:02 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 338/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:44:02 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:04 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:44:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-1a0bfbbd-e6cb-4c14-ae93-c7d257d72ade tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c" status: 200 len: 1443 microversion: 2.1 time: 0.161788 Apr 13 20:44:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 338/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:44:04 2023] GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c6ae32-1e90-4151-b5fe-465e3729a65c", "tag": "9f8191a8-df0e-4838-8422-5a5e85302e9b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] Creating event network-changed:9f8191a8-df0e-4838-8422-5a5e85302e9b for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c on user Apr 13 20:44:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031170 Apr 13 20:44:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 342/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:44:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0c6ae32-1e90-4151-b5fe-465e3729a65c", "tag": "9f8191a8-df0e-4838-8422-5a5e85302e9b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] Creating event network-changed:9f8191a8-df0e-4838-8422-5a5e85302e9b for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c on user Apr 13 20:44:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028757 Apr 13 20:44:06 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 339/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:44:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:06 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:44:06 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c" status: 204 len: 0 microversion: 2.1 time: 0.130805 Apr 13 20:44:06 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 339/1020] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:44:06 2023] DELETE /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:06 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:44:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-e6d469b2-652a-447f-9c21-d0291d4e7cb4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c" status: 200 len: 1568 microversion: 2.1 time: 0.152540 Apr 13 20:44:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 343/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:44:06 2023] GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:44:07 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c6ae32-1e90-4151-b5fe-465e3729a65c", "name": "network-vif-unplugged", "status": "completed", "tag": "9f8191a8-df0e-4838-8422-5a5e85302e9b"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:07 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] Creating event network-vif-unplugged:9f8191a8-df0e-4838-8422-5a5e85302e9b for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c on user Apr 13 20:44:07 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043592 Apr 13 20:44:07 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 340/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:08 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-b485da21-d0a8-4c0c-9178-47a6b63df7a4 req-44f4b381-282e-46f9-a3ce-ae5a5abe537d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c6ae32-1e90-4151-b5fe-465e3729a65c", "name": "network-vif-deleted", "tag": "9f8191a8-df0e-4838-8422-5a5e85302e9b"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b485da21-d0a8-4c0c-9178-47a6b63df7a4 req-44f4b381-282e-46f9-a3ce-ae5a5abe537d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b485da21-d0a8-4c0c-9178-47a6b63df7a4 req-44f4b381-282e-46f9-a3ce-ae5a5abe537d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b485da21-d0a8-4c0c-9178-47a6b63df7a4 req-44f4b381-282e-46f9-a3ce-ae5a5abe537d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-b485da21-d0a8-4c0c-9178-47a6b63df7a4 req-44f4b381-282e-46f9-a3ce-ae5a5abe537d service nova] Creating event network-vif-deleted:9f8191a8-df0e-4838-8422-5a5e85302e9b for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c on user Apr 13 20:44:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-b485da21-d0a8-4c0c-9178-47a6b63df7a4 req-44f4b381-282e-46f9-a3ce-ae5a5abe537d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033442 Apr 13 20:44:08 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 340/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:44:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:09 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0c6ae32-1e90-4151-b5fe-465e3729a65c", "name": "network-vif-plugged", "status": "completed", "tag": "9f8191a8-df0e-4838-8422-5a5e85302e9b"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:09 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] Creating event network-vif-plugged:9f8191a8-df0e-4838-8422-5a5e85302e9b for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c on user Apr 13 20:44:09 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029140 Apr 13 20:44:09 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 344/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:44:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:09 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37c755040ea402f96618b587efb5dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078e29f3a0914d2492f7ff5ac6083859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:44:09 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d67f9a78-66d3-49f3-9292-032d2dbb0dc9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c" status: 200 len: 1567 microversion: 2.1 time: 0.175726 Apr 13 20:44:09 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 341/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:44:09 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:44:14 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38831b52-4793-489b-87ea-3bbad883758c", "tag": "0b225740-55dc-4bb0-be66-3c40b7a25e61"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] Creating event network-changed:0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance 38831b52-4793-489b-87ea-3bbad883758c on user Apr 13 20:44:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032253 Apr 13 20:44:14 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 341/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:44:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:14 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fe3f511-9880-41a0-8b5d-54aa190c2772"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:14 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:14 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:14 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "POST /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263675 Apr 13 20:44:14 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 345/1027] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:44:14 2023] POST /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=16 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:29 user devstack@n-api.service[61654]: DEBUG nova.objects.instance [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'services' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=61654) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:44:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments/9fe3f511-9880-41a0-8b5d-54aa190c2772" status: 202 len: 0 microversion: 2.1 time: 0.279648 Apr 13 20:44:29 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 342/1028] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:44:29 2023] DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments/9fe3f511-9880-41a0-8b5d-54aa190c2772 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:29 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:29 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-60768c9c-8fe4-4aeb-92d1-1088396dc5a9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056710 Apr 13 20:44:29 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 342/1029] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:44:29 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=10 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25bd1b47-9d43-46b2-9f81-5f2bc51cfb24", "device": "/dev/vdb"}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491335 Apr 13 20:44:42 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 346/1030] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:44:42 2023] POST /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:52 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:44:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e29e9003-3ee5-4a98-ac01-0935b5932aaa tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1545 microversion: 2.1 time: 0.176372 Apr 13 20:44:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 343/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:44:52 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1545 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:44:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance e0c6ae32-1e90-4151-b5fe-465e3729a65c could not be found. Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:44:57 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c HTTP/1.1 Apr 13 20:44:57 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:44:57 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:44:57 user devstack@n-api.service[61655]: Connection: close Apr 13 20:44:57 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:44:57 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:44:57 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:44:57 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:44:57 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:44:57 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:44:57 user devstack@n-api.service[61655]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:44:57 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:44:57 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:44:57 user devstack@n-api.service[61655]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:44:57 user devstack@n-api.service[61655]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:44:57 user devstack@n-api.service[61655]: method: > Apr 13 20:44:57 user devstack@n-api.service[61655]: exception: Instance e0c6ae32-1e90-4151-b5fe-465e3729a65c could not be found. Apr 13 20:44:57 user devstack@n-api.service[61655]: action_args: {'id': 'e0c6ae32-1e90-4151-b5fe-465e3729a65c'} Apr 13 20:44:57 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c6ae32-1e90-4151-b5fe-465e3729a65c could not be found. Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c6ae32-1e90-4151-b5fe-465e3729a65c could not be found. Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c6ae32-1e90-4151-b5fe-465e3729a65c could not be found. Apr 13 20:44:57 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:44:57 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance e0c6ae32-1e90-4151-b5fe-465e3729a65c could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:44:57 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4b71fb74-4cc1-42b2-b3fc-40151d4ae2a7 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c" status: 404 len: 111 microversion: 2.1 time: 0.150708 Apr 13 20:44:57 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 343/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:44:57 2023] GET /compute/v2.1/servers/e0c6ae32-1e90-4151-b5fe-465e3729a65c => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:02 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'services' on Instance uuid 0865046e-7479-409c-9105-f202b4629851 {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:45:02 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851/os-volume_attachments/25bd1b47-9d43-46b2-9f81-5f2bc51cfb24" status: 202 len: 0 microversion: 2.1 time: 0.176836 Apr 13 20:45:02 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 347/1033] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:45:02 2023] DELETE /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851/os-volume_attachments/25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:02 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:45:02 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851" status: 204 len: 0 microversion: 2.1 time: 0.141420 Apr 13 20:45:02 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 344/1034] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:45:02 2023] DELETE /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:02 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24880a07e48f4125b4a63048c6f5237b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8f583cda274b8ba1e6383d1aa142d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:45:02 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8db1f865-c23b-4963-b384-7cc905868583 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851" status: 200 len: 1548 microversion: 2.1 time: 0.222008 Apr 13 20:45:02 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 344/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:45:02 2023] GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851 => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:45:04 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Going to try to terminate instance {{(pid=61653) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:45:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] Creating event network-changed:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:45:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116893 Apr 13 20:45:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 345/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:45:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:45:04 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe" status: 204 len: 0 microversion: 2.1 time: 0.214307 Apr 13 20:45:04 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 348/1037] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:45:04 2023] DELETE /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:04 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-unplugged", "status": "completed", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:45:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:04 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] Creating event network-vif-unplugged:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:45:04 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052390 Apr 13 20:45:04 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 346/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:45:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:45:04 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:45:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-92e58486-06c4-483a-a6f5-ee1bd1eb9b8b tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe" status: 200 len: 1569 microversion: 2.1 time: 0.318621 Apr 13 20:45:04 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 345/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:45:04 2023] GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe => generated 1569 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:45:06 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0865046e-7479-409c-9105-f202b4629851", "name": "network-vif-unplugged", "status": "completed", "tag": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21"}, {"server_uuid": "0865046e-7479-409c-9105-f202b4629851", "name": "network-vif-plugged", "status": "completed", "tag": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21"}, {"server_uuid": "0865046e-7479-409c-9105-f202b4629851", "name": "network-vif-deleted", "tag": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:45:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:06 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Creating event network-vif-unplugged:b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance 0865046e-7479-409c-9105-f202b4629851 on user Apr 13 20:45:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Creating event network-vif-plugged:b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance 0865046e-7479-409c-9105-f202b4629851 on user Apr 13 20:45:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Creating event network-vif-deleted:b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance 0865046e-7479-409c-9105-f202b4629851 on user Apr 13 20:45:06 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.039185 Apr 13 20:45:06 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 349/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:45:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-plugged", "status": "completed", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}, {"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-plugged", "status": "completed", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}, {"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-plugged", "status": "completed", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}, {"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-unplugged", "status": "completed", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}, {"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-plugged", "status": "completed", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:45:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Creating event network-vif-plugged:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:45:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Creating event network-vif-plugged:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:45:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Creating event network-vif-plugged:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:45:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Creating event network-vif-unplugged:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:45:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Creating event network-vif-plugged:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:45:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031949 Apr 13 20:45:06 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 347/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:45:08 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-d3b7ae3f-9746-4b9f-9ef3-7c448b2ad0a3 req-fa6f25d0-7baa-4c72-95c8-e0075b1f60fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7253b3f-8d1c-4bf4-a591-5088074aafbe", "name": "network-vif-deleted", "tag": "9c4f6683-1965-4f34-9834-9872c4f4ff98"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:45:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d3b7ae3f-9746-4b9f-9ef3-7c448b2ad0a3 req-fa6f25d0-7baa-4c72-95c8-e0075b1f60fc service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d3b7ae3f-9746-4b9f-9ef3-7c448b2ad0a3 req-fa6f25d0-7baa-4c72-95c8-e0075b1f60fc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:08 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d3b7ae3f-9746-4b9f-9ef3-7c448b2ad0a3 req-fa6f25d0-7baa-4c72-95c8-e0075b1f60fc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-d3b7ae3f-9746-4b9f-9ef3-7c448b2ad0a3 req-fa6f25d0-7baa-4c72-95c8-e0075b1f60fc service nova] Creating event network-vif-deleted:9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe on user Apr 13 20:45:08 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-d3b7ae3f-9746-4b9f-9ef3-7c448b2ad0a3 req-fa6f25d0-7baa-4c72-95c8-e0075b1f60fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029600 Apr 13 20:45:08 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 346/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1b63861d-9fff-4e65-9823-2c566e022b05 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049906 Apr 13 20:45:20 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 350/1043] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:45:20 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ce2d7b8-f928-4321-8a72-ec1f605cb147"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "POST /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318553 Apr 13 20:45:24 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 348/1044] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:45:23 2023] POST /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=8 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=16 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:31 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'services' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:45:31 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments/3ce2d7b8-f928-4321-8a72-ec1f605cb147" status: 202 len: 0 microversion: 2.1 time: 0.161465 Apr 13 20:45:31 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 347/1045] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:45:31 2023] DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments/3ce2d7b8-f928-4321-8a72-ec1f605cb147 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:31 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:31 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-ae9673f6-01ec-4454-964e-5355ab42f7ec tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Apr 13 20:45:31 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 351/1046] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:45:31 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:52 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:45:52 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-a8d2d177-ba21-4507-9a39-e4e26878134e tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1545 microversion: 2.1 time: 0.294839 Apr 13 20:45:52 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 349/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:45:52 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1545 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:52 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] HTTP exception thrown: Instance 0865046e-7479-409c-9105-f202b4629851 could not be found. Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Request method failure captured: Apr 13 20:45:52 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851 HTTP/1.1 Apr 13 20:45:52 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:45:52 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:45:52 user devstack@n-api.service[61653]: Connection: close Apr 13 20:45:52 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:45:52 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:45:52 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:45:52 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:45:52 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGiEaRWDy0DrY6gZYP1Rdh0QxfjVo99ULplb1LmL0pUSyLhoSceYE_qCmJjJQ0FgsFi2rICuC3XCFlyOMWBgi677IvoMOyA7oHVEQgJ96ztxcmEFr3D8tFk-UphIwiJ7t_6zgyoy9ZbdNl9DSCUvmrvs_Z4Xp6JzpzicSJV94Kv_uAI Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Project-Id: 0a8f583cda274b8ba1e6383d1aa142d7 Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2146034860 Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a8f583cda274b8ba1e6383d1aa142d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a8f583cda274b8ba1e6383d1aa142d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a8f583cda274b8ba1e6383d1aa142d7"}]}] Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Tenant: tempest-VolumesSnapshotTestJSON-2146034860 Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Tenant-Id: 0a8f583cda274b8ba1e6383d1aa142d7 Apr 13 20:45:52 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2146034860 Apr 13 20:45:52 user devstack@n-api.service[61653]: X-User: tempest-VolumesSnapshotTestJSON-2146034860-project-member Apr 13 20:45:52 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:45:52 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:45:52 user devstack@n-api.service[61653]: X-User-Id: 24880a07e48f4125b4a63048c6f5237b Apr 13 20:45:52 user devstack@n-api.service[61653]: X-User-Name: tempest-VolumesSnapshotTestJSON-2146034860-project-member Apr 13 20:45:52 user devstack@n-api.service[61653]: method: > Apr 13 20:45:52 user devstack@n-api.service[61653]: exception: Instance 0865046e-7479-409c-9105-f202b4629851 could not be found. Apr 13 20:45:52 user devstack@n-api.service[61653]: action_args: {'id': '0865046e-7479-409c-9105-f202b4629851'} Apr 13 20:45:52 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0865046e-7479-409c-9105-f202b4629851 could not be found. Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0865046e-7479-409c-9105-f202b4629851 could not be found. Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0865046e-7479-409c-9105-f202b4629851 could not be found. Apr 13 20:45:52 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Returning 404 to user: Instance 0865046e-7479-409c-9105-f202b4629851 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:45:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-0e7de666-a2b9-4064-9cda-fb6c52c258f5 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851" status: 404 len: 111 microversion: 2.1 time: 0.032051 Apr 13 20:45:52 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 352/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:45:52 2023] GET /compute/v2.1/servers/0865046e-7479-409c-9105-f202b4629851 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:45:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "POST /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94/action" status: 200 len: 28456 microversion: 2.1 time: 0.336717 Apr 13 20:45:53 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 348/1049] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 20:45:52 2023] POST /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94/action => generated 28456 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:53 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:45:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-23dcd502-f199-4f82-ba24-8b3e971a1c30 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b" status: 200 len: 1540 microversion: 2.1 time: 0.482473 Apr 13 20:45:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 350/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:45:53 2023] GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b => generated 1540 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe could not be found. Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:45:54 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe HTTP/1.1 Apr 13 20:45:54 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:45:54 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:45:54 user devstack@n-api.service[61653]: Connection: close Apr 13 20:45:54 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:45:54 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:45:54 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:45:54 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:45:54 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:45:54 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:54 user devstack@n-api.service[61653]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:45:54 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:45:54 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:45:54 user devstack@n-api.service[61653]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:45:54 user devstack@n-api.service[61653]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:45:54 user devstack@n-api.service[61653]: method: > Apr 13 20:45:54 user devstack@n-api.service[61653]: exception: Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe could not be found. Apr 13 20:45:54 user devstack@n-api.service[61653]: action_args: {'id': 'f7253b3f-8d1c-4bf4-a591-5088074aafbe'} Apr 13 20:45:54 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe could not be found. Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe could not be found. Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe could not be found. Apr 13 20:45:54 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:45:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:45:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7b3111f9-f4a8-4f76-908b-136a433a25b5 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe" status: 404 len: 111 microversion: 2.1 time: 0.033170 Apr 13 20:45:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 353/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:45:54 2023] GET /compute/v2.1/servers/f7253b3f-8d1c-4bf4-a591-5088074aafbe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:45:55 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 HTTP/1.1 Apr 13 20:45:55 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:45:55 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:45:55 user devstack@n-api.service[61655]: Connection: close Apr 13 20:45:55 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:45:55 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:45:55 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:45:55 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:45:55 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:45:55 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:55 user devstack@n-api.service[61655]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:45:55 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:45:55 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:45:55 user devstack@n-api.service[61655]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:45:55 user devstack@n-api.service[61655]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:45:55 user devstack@n-api.service[61655]: method: > Apr 13 20:45:55 user devstack@n-api.service[61655]: exception: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61655]: action_args: {'id': '6c4d5801-3b71-4ce3-83b9-9bf54507c444'} Apr 13 20:45:55 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:45:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-beb0547b-cd6d-480e-9eb0-a695201317e0 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444" status: 404 len: 111 microversion: 2.1 time: 0.030101 Apr 13 20:45:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 349/1052] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:45:55 2023] DELETE /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:45:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HTTP exception thrown: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Request method failure captured: Apr 13 20:45:55 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 HTTP/1.1 Apr 13 20:45:55 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:45:55 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:45:55 user devstack@n-api.service[61654]: Connection: close Apr 13 20:45:55 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:45:55 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:45:55 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:45:55 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:45:55 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGYEbZxItDHnfHVlgsp-TyIShsQmkzbr2rnuiCu49vqYBmgJTMLkRc4Z2Otd8UrUfGq8MoFF_vUbq5vEbitCdhNiWwnkC0vOgIRz9z_azJnLGptKRs7pOMMpD4BzM2Lapaw47U59seEDnHIk0vOhontqA_DNkreg_gqHqMB2M2JImBw Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Project-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Project-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65dc7126add94e0c97afbe225c8447a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65dc7126add94e0c97afbe225c8447a4"}]}] Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Tenant: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Tenant-Id: 65dc7126add94e0c97afbe225c8447a4 Apr 13 20:45:55 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-TestVolumeBootPattern-2040418736 Apr 13 20:45:55 user devstack@n-api.service[61654]: X-User: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:45:55 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:45:55 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:45:55 user devstack@n-api.service[61654]: X-User-Id: 7e478a11b57b4ee385e33c4709adf04b Apr 13 20:45:55 user devstack@n-api.service[61654]: X-User-Name: tempest-TestVolumeBootPattern-2040418736-project-member Apr 13 20:45:55 user devstack@n-api.service[61654]: method: > Apr 13 20:45:55 user devstack@n-api.service[61654]: exception: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61654]: action_args: {'id': '6c4d5801-3b71-4ce3-83b9-9bf54507c444'} Apr 13 20:45:55 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. Apr 13 20:45:55 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:45:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Returning 404 to user: Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:45:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e5e8b83c-a728-4d7c-9a04-c780b74bb7d3 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444" status: 404 len: 111 microversion: 2.1 time: 0.029808 Apr 13 20:45:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 351/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:45:55 2023] GET /compute/v2.1/servers/6c4d5801-3b71-4ce3-83b9-9bf54507c444 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:45:57 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-4a91eaa5-e727-4717-8a4a-b5a79a60042f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Calling method '.version_select at 0x7f7833d60700>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:45:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-4a91eaa5-e727-4717-8a4a-b5a79a60042f tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1472807234" status: 202 len: 0 microversion: 2.1 time: 0.034019 Apr 13 20:45:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 354/1054] 10.0.0.210 () {62 vars in 1340 bytes} [Thu Apr 13 20:45:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1472807234 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:21 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-fb8fd3b6-9017-4695-9ff2-d087ce67727c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062251 Apr 13 20:46:21 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 350/1055] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:46:21 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5690bf06-3948-4710-adc5-a9ea83e171b6"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=14 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:23 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "POST /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301077 Apr 13 20:46:24 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 352/1056] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:46:23 2023] POST /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:32 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'services' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:46:32 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments/5690bf06-3948-4710-adc5-a9ea83e171b6" status: 202 len: 0 microversion: 2.1 time: 0.320668 Apr 13 20:46:32 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 355/1057] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:46:32 2023] DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments/5690bf06-3948-4710-adc5-a9ea83e171b6 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-2ea31d22-1982-48ff-9edf-8d32643b63d9 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056135 Apr 13 20:46:32 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 351/1058] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:46:32 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:53 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:46:53 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 204 len: 0 microversion: 2.1 time: 0.130501 Apr 13 20:46:53 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 353/1059] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:46:53 2023] DELETE /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:54 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:46:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-2ab8afe5-5c93-40b8-b01a-64d2edd30d92 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 200 len: 1551 microversion: 2.1 time: 0.236684 Apr 13 20:46:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 356/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:46:53 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 1551 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:46:54 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:54 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:46:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-unplugged", "status": "completed", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:46:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] Creating event network-vif-unplugged:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:46:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.214410 Apr 13 20:46:54 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 352/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:46:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-699be368-0e11-48a7-aaab-14ba6f60392b req-abfe96dd-1e53-4eef-93fd-d0796b5f3c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-deleted", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:46:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-699be368-0e11-48a7-aaab-14ba6f60392b req-abfe96dd-1e53-4eef-93fd-d0796b5f3c45 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-699be368-0e11-48a7-aaab-14ba6f60392b req-abfe96dd-1e53-4eef-93fd-d0796b5f3c45 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-699be368-0e11-48a7-aaab-14ba6f60392b req-abfe96dd-1e53-4eef-93fd-d0796b5f3c45 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-699be368-0e11-48a7-aaab-14ba6f60392b req-abfe96dd-1e53-4eef-93fd-d0796b5f3c45 service nova] Creating event network-vif-deleted:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:46:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-699be368-0e11-48a7-aaab-14ba6f60392b req-abfe96dd-1e53-4eef-93fd-d0796b5f3c45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031075 Apr 13 20:46:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 354/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:46:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cad31b-84d7-4b5b-b932-747848852c94", "name": "network-vif-plugged", "status": "completed", "tag": "0bead699-f8a2-4731-bd2f-145f524e77b6"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:46:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:46:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:46:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:46:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] Creating event network-vif-plugged:0bead699-f8a2-4731-bd2f-145f524e77b6 for instance 99cad31b-84d7-4b5b-b932-747848852c94 on user Apr 13 20:46:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031231 Apr 13 20:46:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 357/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:22 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:22 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c856cc3a-1292-4b59-b18c-7c387502a7e3 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.228117 Apr 13 20:47:22 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 353/1064] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:47:22 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 25 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5960e646-9ff4-4019-b4c1-b5ab3f92a71e"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:25 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:25 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "POST /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271143 Apr 13 20:47:25 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 355/1065] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 20:47:25 2023] POST /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:32 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:33 user devstack@n-api.service[61653]: DEBUG nova.objects.instance [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'services' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=61653) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:47:33 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments/5960e646-9ff4-4019-b4c1-b5ab3f92a71e" status: 202 len: 0 microversion: 2.1 time: 0.199652 Apr 13 20:47:33 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 358/1066] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 20:47:32 2023] DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments/5960e646-9ff4-4019-b4c1-b5ab3f92a71e => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:33 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-6bfbf1be-a76e-4614-9646-0997296f023f tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056904 Apr 13 20:47:33 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 354/1067] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:47:33 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:47:44 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 HTTP/1.1 Apr 13 20:47:44 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:47:44 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:47:44 user devstack@n-api.service[61654]: Connection: close Apr 13 20:47:44 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:47:44 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:47:44 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:47:44 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:47:44 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:47:44 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61654]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:47:44 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:47:44 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:47:44 user devstack@n-api.service[61654]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:47:44 user devstack@n-api.service[61654]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:47:44 user devstack@n-api.service[61654]: method: > Apr 13 20:47:44 user devstack@n-api.service[61654]: exception: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61654]: action_args: {'id': '99cad31b-84d7-4b5b-b932-747848852c94'} Apr 13 20:47:44 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:47:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-eed84d07-5969-4a18-b8ae-7c7c00dd7dec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 404 len: 111 microversion: 2.1 time: 0.037354 Apr 13 20:47:44 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 356/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:47:44 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:47:44 user devstack@n-api.service[61653]: request: DELETE /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 HTTP/1.1 Apr 13 20:47:44 user devstack@n-api.service[61653]: Accept: application/json Apr 13 20:47:44 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 20:47:44 user devstack@n-api.service[61653]: Connection: close Apr 13 20:47:44 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 20:47:44 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 20:47:44 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 20:47:44 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 20:47:44 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:47:44 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61653]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:47:44 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 20:47:44 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 20:47:44 user devstack@n-api.service[61653]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:47:44 user devstack@n-api.service[61653]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:47:44 user devstack@n-api.service[61653]: method: > Apr 13 20:47:44 user devstack@n-api.service[61653]: exception: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61653]: action_args: {'id': '99cad31b-84d7-4b5b-b932-747848852c94'} Apr 13 20:47:44 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:47:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-eedfae8f-626d-48c6-aa16-b5a20a4133ac tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 404 len: 111 microversion: 2.1 time: 0.039063 Apr 13 20:47:44 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 359/1069] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:47:44 2023] DELETE /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:47:44 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 HTTP/1.1 Apr 13 20:47:44 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:47:44 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:47:44 user devstack@n-api.service[61655]: Connection: close Apr 13 20:47:44 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:47:44 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:47:44 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:47:44 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:47:44 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:47:44 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:47:44 user devstack@n-api.service[61655]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:47:44 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:47:44 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:47:44 user devstack@n-api.service[61655]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:47:44 user devstack@n-api.service[61655]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:47:44 user devstack@n-api.service[61655]: method: > Apr 13 20:47:44 user devstack@n-api.service[61655]: exception: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61655]: action_args: {'id': '99cad31b-84d7-4b5b-b932-747848852c94'} Apr 13 20:47:44 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. Apr 13 20:47:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:47:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance 99cad31b-84d7-4b5b-b932-747848852c94 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:47:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-296fdd37-21a8-49a0-90d4-2433f4a4e1d9 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94" status: 404 len: 111 microversion: 2.1 time: 0.031139 Apr 13 20:47:44 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 355/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:47:44 2023] GET /compute/v2.1/servers/99cad31b-84d7-4b5b-b932-747848852c94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:47:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b" status: 204 len: 0 microversion: 2.1 time: 0.111579 Apr 13 20:47:44 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 357/1071] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:47:44 2023] DELETE /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:44 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:47:44 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-14387f6f-f601-47c7-aae2-83dc5dca87ec tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b" status: 200 len: 1546 microversion: 2.1 time: 0.209800 Apr 13 20:47:44 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 360/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:47:44 2023] GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b => generated 1546 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:47:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632463fb-75e1-458a-b9f7-8a19fdf7409b", "name": "network-vif-unplugged", "status": "completed", "tag": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:47:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] Creating event network-vif-unplugged:1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b on user Apr 13 20:47:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098237 Apr 13 20:47:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 356/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:47:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:47:45 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-47dedb25-ad5d-4384-bb02-e502b7d67861 req-cb9cf585-d0f2-4fe0-a50e-e519884acc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632463fb-75e1-458a-b9f7-8a19fdf7409b", "name": "network-vif-deleted", "tag": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:47:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-47dedb25-ad5d-4384-bb02-e502b7d67861 req-cb9cf585-d0f2-4fe0-a50e-e519884acc76 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-47dedb25-ad5d-4384-bb02-e502b7d67861 req-cb9cf585-d0f2-4fe0-a50e-e519884acc76 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-47dedb25-ad5d-4384-bb02-e502b7d67861 req-cb9cf585-d0f2-4fe0-a50e-e519884acc76 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-47dedb25-ad5d-4384-bb02-e502b7d67861 req-cb9cf585-d0f2-4fe0-a50e-e519884acc76 service nova] Creating event network-vif-deleted:1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b on user Apr 13 20:47:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-47dedb25-ad5d-4384-bb02-e502b7d67861 req-cb9cf585-d0f2-4fe0-a50e-e519884acc76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035301 Apr 13 20:47:45 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 358/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:47:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632463fb-75e1-458a-b9f7-8a19fdf7409b", "name": "network-vif-plugged", "status": "completed", "tag": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:47:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:47:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:47:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:47:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] Creating event network-vif-plugged:1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b on user Apr 13 20:47:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030226 Apr 13 20:47:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 361/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:47:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-d24a79f7-333a-4155-a167-0add99679afb tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059559 Apr 13 20:48:23 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 357/1076] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 20:48:23 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b could not be found. Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:48:34 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b HTTP/1.1 Apr 13 20:48:34 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:48:34 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:48:34 user devstack@n-api.service[61654]: Connection: close Apr 13 20:48:34 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:48:34 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:48:34 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:48:34 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:48:34 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:48:34 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:34 user devstack@n-api.service[61654]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:48:34 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:48:34 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:48:34 user devstack@n-api.service[61654]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:48:34 user devstack@n-api.service[61654]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:48:34 user devstack@n-api.service[61654]: method: > Apr 13 20:48:34 user devstack@n-api.service[61654]: exception: Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b could not be found. Apr 13 20:48:34 user devstack@n-api.service[61654]: action_args: {'id': '632463fb-75e1-458a-b9f7-8a19fdf7409b'} Apr 13 20:48:34 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b could not be found. Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b could not be found. Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b could not be found. Apr 13 20:48:34 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:34 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:48:34 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-4327a809-ea12-4b6e-bd19-4ab1471372a6 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b" status: 404 len: 111 microversion: 2.1 time: 0.055409 Apr 13 20:48:34 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 359/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:48:34 2023] GET /compute/v2.1/servers/632463fb-75e1-458a-b9f7-8a19fdf7409b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:48:38 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38831b52-4793-489b-87ea-3bbad883758c", "tag": "0b225740-55dc-4bb0-be66-3c40b7a25e61"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:48:38 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:38 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=10 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:38 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] Creating event network-changed:0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance 38831b52-4793-489b-87ea-3bbad883758c on user Apr 13 20:48:38 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045960 Apr 13 20:48:38 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 362/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:48:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:48:40 user devstack@n-api.service[61655]: request: DELETE /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 HTTP/1.1 Apr 13 20:48:40 user devstack@n-api.service[61655]: Accept: application/json Apr 13 20:48:40 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 20:48:40 user devstack@n-api.service[61655]: Connection: close Apr 13 20:48:40 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 20:48:40 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 20:48:40 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 20:48:40 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 20:48:40 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:48:40 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:40 user devstack@n-api.service[61655]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:48:40 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 20:48:40 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 20:48:40 user devstack@n-api.service[61655]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:48:40 user devstack@n-api.service[61655]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:48:40 user devstack@n-api.service[61655]: method: > Apr 13 20:48:40 user devstack@n-api.service[61655]: exception: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61655]: action_args: {'id': 'b8bcf189-a781-474e-bc4f-8a471a661e93'} Apr 13 20:48:40 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:48:40 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-e14c9191-0f65-4b36-bdb5-a19e954080b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 404 len: 111 microversion: 2.1 time: 0.031956 Apr 13 20:48:40 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 358/1079] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:48:40 2023] DELETE /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HTTP exception thrown: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Request method failure captured: Apr 13 20:48:40 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 HTTP/1.1 Apr 13 20:48:40 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:48:40 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:48:40 user devstack@n-api.service[61654]: Connection: close Apr 13 20:48:40 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:48:40 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:48:40 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:48:40 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:48:40 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGTcrHhD72-8CQz90JqlbljObrTUMFX5jC9WHIA3Axn9YMbcyExh2B-r1g8sD4zSVQdUkoe5y0VB5pXdq1eC871tLOGodQDcgoAorucKQAfYNYAlM_FGGiFLTTDm2zIJlHBRbQQMSnkyQCKrr9fKBaKrKa8IwY8wI0Ehjz4qYuYkcGU Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Project-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Project-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c0e9553d7d1f49f68d3b20cb647f2062"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c0e9553d7d1f49f68d3b20cb647f2062"}]}] Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Tenant: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Tenant-Id: c0e9553d7d1f49f68d3b20cb647f2062 Apr 13 20:48:40 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-ServerActionsTestJSON-1522960802 Apr 13 20:48:40 user devstack@n-api.service[61654]: X-User: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:48:40 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:48:40 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:48:40 user devstack@n-api.service[61654]: X-User-Id: 04d351d2822a460d93748b98161d730c Apr 13 20:48:40 user devstack@n-api.service[61654]: X-User-Name: tempest-ServerActionsTestJSON-1522960802-project-member Apr 13 20:48:40 user devstack@n-api.service[61654]: method: > Apr 13 20:48:40 user devstack@n-api.service[61654]: exception: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61654]: action_args: {'id': 'b8bcf189-a781-474e-bc4f-8a471a661e93'} Apr 13 20:48:40 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. Apr 13 20:48:40 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:48:40 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Returning 404 to user: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:48:40 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-08c5b0bd-b252-4482-a570-0657a11ec0dd tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93" status: 404 len: 111 microversion: 2.1 time: 0.034510 Apr 13 20:48:40 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 360/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:48:40 2023] GET /compute/v2.1/servers/b8bcf189-a781-474e-bc4f-8a471a661e93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:48:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-949b467b-6c0a-49cb-a9fd-6ca561ba6ac8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Calling method '.version_select at 0x7f7833e22dd0>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:48:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-949b467b-6c0a-49cb-a9fd-6ca561ba6ac8 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514913657" status: 202 len: 0 microversion: 2.1 time: 0.024218 Apr 13 20:48:40 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 363/1081] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 20:48:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514913657 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:42 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 20:48:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c" status: 204 len: 0 microversion: 2.1 time: 0.119300 Apr 13 20:48:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 359/1082] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 20:48:42 2023] DELETE /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:43 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd37c755040ea402f96618b587efb5dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078e29f3a0914d2492f7ff5ac6083859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:48:43 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-d33b3f91-282c-43a6-a884-3df04e8aa1a2 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c" status: 200 len: 1573 microversion: 2.1 time: 0.284999 Apr 13 20:48:43 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 361/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:48:43 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c => generated 1573 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:48:43 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38831b52-4793-489b-87ea-3bbad883758c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b225740-55dc-4bb0-be66-3c40b7a25e61"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:48:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:43 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] Creating event network-vif-unplugged:0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance 38831b52-4793-489b-87ea-3bbad883758c on user Apr 13 20:48:43 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030122 Apr 13 20:48:43 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 364/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:48:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:48:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-1d17fb37-4348-44fa-99d6-5d4afdb4db25 req-247f3f4f-871f-480e-bfbf-8d8cf3a8760c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38831b52-4793-489b-87ea-3bbad883758c", "name": "network-vif-deleted", "tag": "0b225740-55dc-4bb0-be66-3c40b7a25e61"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:48:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1d17fb37-4348-44fa-99d6-5d4afdb4db25 req-247f3f4f-871f-480e-bfbf-8d8cf3a8760c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1d17fb37-4348-44fa-99d6-5d4afdb4db25 req-247f3f4f-871f-480e-bfbf-8d8cf3a8760c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-1d17fb37-4348-44fa-99d6-5d4afdb4db25 req-247f3f4f-871f-480e-bfbf-8d8cf3a8760c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-1d17fb37-4348-44fa-99d6-5d4afdb4db25 req-247f3f4f-871f-480e-bfbf-8d8cf3a8760c service nova] Creating event network-vif-deleted:0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance 38831b52-4793-489b-87ea-3bbad883758c on user Apr 13 20:48:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-1d17fb37-4348-44fa-99d6-5d4afdb4db25 req-247f3f4f-871f-480e-bfbf-8d8cf3a8760c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032841 Apr 13 20:48:44 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 360/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:48:45 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38831b52-4793-489b-87ea-3bbad883758c", "name": "network-vif-plugged", "status": "completed", "tag": "0b225740-55dc-4bb0-be66-3c40b7a25e61"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:48:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] Creating event network-vif-plugged:0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance 38831b52-4793-489b-87ea-3bbad883758c on user Apr 13 20:48:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040225 Apr 13 20:48:45 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 362/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:48:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-48633921", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "b179b938-6cf3-4860-b1ac-e243ded4df5f"}]}} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:48:52 user devstack@n-api.service[61653]: DEBUG nova.network.neutron [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] validate_networks() for [('b179b938-6cf3-4860-b1ac-e243ded4df5f', None, None, None, None, None)] {{(pid=61653) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61653) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting quotas for project c9873771332b48b78929463707ce74d0. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.quota [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting quotas for user ce4e20ca99b8451c9087c565778ab88f and project c9873771332b48b78929463707ce74d0. Resources: {'instances', 'cores', 'ram'} {{(pid=61653) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Going to run 1 instances... {{(pid=61653) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:48:53 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61653) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:48:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.817039 Apr 13 20:48:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 365/1087] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 20:48:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 20:48:53 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-cac5b4af-ef6e-455b-96d6-5390f6bdd0db tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:48:53 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-cac5b4af-ef6e-455b-96d6-5390f6bdd0db tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:48:53 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-cac5b4af-ef6e-455b-96d6-5390f6bdd0db tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:48:53 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-cac5b4af-ef6e-455b-96d6-5390f6bdd0db tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:48:53 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-cac5b4af-ef6e-455b-96d6-5390f6bdd0db tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:48:53 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-cac5b4af-ef6e-455b-96d6-5390f6bdd0db tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" status: 200 len: 1393 microversion: 2.87 time: 0.080009 Apr 13 20:48:53 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 361/1088] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:48:53 2023] GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => generated 1393 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:48:55 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:55 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=12 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:55 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9", "tag": "7010d8a1-cb74-49c7-9be0-dc0da456ad67"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:48:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:55 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] Creating event network-changed:7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 on user Apr 13 20:48:55 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032825 Apr 13 20:48:55 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 363/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:48:57 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9", "name": "network-vif-plugged", "status": "completed", "tag": "7010d8a1-cb74-49c7-9be0-dc0da456ad67"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:48:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:57 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] Creating event network-vif-plugged:7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 on user Apr 13 20:48:57 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072840 Apr 13 20:48:57 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 366/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:48:59 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:48:59 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9", "name": "network-vif-plugged", "status": "completed", "tag": "7010d8a1-cb74-49c7-9be0-dc0da456ad67"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:48:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:48:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:48:59 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:48:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] Creating event network-vif-plugged:7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 on user Apr 13 20:48:59 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035186 Apr 13 20:48:59 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 362/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:48:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:49:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] HTTP exception thrown: Instance 38831b52-4793-489b-87ea-3bbad883758c could not be found. Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Request method failure captured: Apr 13 20:49:33 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c HTTP/1.1 Apr 13 20:49:33 user devstack@n-api.service[61654]: Accept: application/json Apr 13 20:49:33 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 20:49:33 user devstack@n-api.service[61654]: Connection: close Apr 13 20:49:33 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 20:49:33 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 20:49:33 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 20:49:33 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 20:49:33 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOGkfFC3Mn_NNDb_P22p_MthqdFmBN8MBI1U5iAJv7ZBXmYMsrIX9a4fLETk8Tp77NGcZVSdCcgHKRCgdd0zjoMPfmDaAgi_URvkAv8qxFvgr88M4OeynzLdvoTfmcUT6dVsYJPcRbnnU0OBiN_1cyZitffWko_E-qHRAEefOQpFEMbU Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Project-Id: 078e29f3a0914d2492f7ff5ac6083859 Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1436433817 Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/078e29f3a0914d2492f7ff5ac6083859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/078e29f3a0914d2492f7ff5ac6083859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/078e29f3a0914d2492f7ff5ac6083859"}]}] Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Tenant: tempest-SnapshotDataIntegrityTests-1436433817 Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Tenant-Id: 078e29f3a0914d2492f7ff5ac6083859 Apr 13 20:49:33 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1436433817 Apr 13 20:49:33 user devstack@n-api.service[61654]: X-User: tempest-SnapshotDataIntegrityTests-1436433817-project-member Apr 13 20:49:33 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 20:49:33 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 20:49:33 user devstack@n-api.service[61654]: X-User-Id: d37c755040ea402f96618b587efb5dca Apr 13 20:49:33 user devstack@n-api.service[61654]: X-User-Name: tempest-SnapshotDataIntegrityTests-1436433817-project-member Apr 13 20:49:33 user devstack@n-api.service[61654]: method: > Apr 13 20:49:33 user devstack@n-api.service[61654]: exception: Instance 38831b52-4793-489b-87ea-3bbad883758c could not be found. Apr 13 20:49:33 user devstack@n-api.service[61654]: action_args: {'id': '38831b52-4793-489b-87ea-3bbad883758c'} Apr 13 20:49:33 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38831b52-4793-489b-87ea-3bbad883758c could not be found. Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38831b52-4793-489b-87ea-3bbad883758c could not be found. Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38831b52-4793-489b-87ea-3bbad883758c could not be found. Apr 13 20:49:33 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 20:49:33 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Returning 404 to user: Instance 38831b52-4793-489b-87ea-3bbad883758c could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 20:49:33 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2996d869-49a8-4075-9be2-b741a7251e90 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c" status: 404 len: 111 microversion: 2.1 time: 0.034614 Apr 13 20:49:33 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 364/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 20:49:33 2023] GET /compute/v2.1/servers/38831b52-4793-489b-87ea-3bbad883758c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 20:49:33 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:33 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:33 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:33 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:33 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7b32da45-ccaa-4824-8b4b-f217ead45176 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Calling method '.version_select at 0x7f7833e22170>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:49:33 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7b32da45-ccaa-4824-8b4b-f217ead45176 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1395940804" status: 202 len: 0 microversion: 2.1 time: 0.041812 Apr 13 20:49:33 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 367/1093] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 13 20:49:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1395940804 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:49:43 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:49:43 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c4852674-9d14-4784-b400-d57cf7478053 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" status: 200 len: 1689 microversion: 2.87 time: 0.206643 Apr 13 20:49:43 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 363/1094] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:49:43 2023] GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1601941513"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:50:43 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:50:44 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/action" status: 202 len: 52 microversion: 2.87 time: 0.974201 Apr 13 20:50:44 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 365/1095] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 20:50:43 2023] POST /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/action => generated 52 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:50:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:50:50 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:50:50 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:50:50 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:50:50 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-6582120d-87c2-4603-9c0e-4c652116c3e1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" status: 200 len: 1689 microversion: 2.87 time: 0.335823 Apr 13 20:50:50 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 368/1096] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:50:49 2023] GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => generated 1689 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:51:50 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:51:50 user devstack@n-api.service[61655]: Thu Apr 13 20:51:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1443572831", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "b179b938-6cf3-4860-b1ac-e243ded4df5f"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] validate_networks() for [('b179b938-6cf3-4860-b1ac-e243ded4df5f', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting quotas for project c9873771332b48b78929463707ce74d0. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting quotas for user ce4e20ca99b8451c9087c565778ab88f and project c9873771332b48b78929463707ce74d0. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:51:50 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:51:51 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.688832 Apr 13 20:51:51 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 364/1097] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 20:51:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 20:51:51 user devstack@n-api.service[61654]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 20:51:51 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:51:51 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:51:51 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-8a18534f-887d-4d34-8f3b-e487fbc1b64f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:51:51 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-8a18534f-887d-4d34-8f3b-e487fbc1b64f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:51:51 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-8a18534f-887d-4d34-8f3b-e487fbc1b64f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:51:51 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-8a18534f-887d-4d34-8f3b-e487fbc1b64f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:51:51 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-8a18534f-887d-4d34-8f3b-e487fbc1b64f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:51:51 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-8a18534f-887d-4d34-8f3b-e487fbc1b64f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 200 len: 1395 microversion: 2.87 time: 0.097168 Apr 13 20:51:51 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 366/1098] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:51:51 2023] GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 1395 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:51:53 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:51:53 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:51:53 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:51:53 user devstack@n-api.service[61653]: Thu Apr 13 20:51:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 13 20:51:53 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:51:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:51:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:51:53 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:51:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] Creating event network-changed:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:51:53 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091780 Apr 13 20:51:53 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 369/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:52:06 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:52:06 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:52:06 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:52:06 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:52:06 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:52:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:52:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:52:06 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:52:06 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:52:06 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042989 Apr 13 20:52:06 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 365/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:52:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:52:08 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:52:08 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:52:08 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:52:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:52:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:52:08 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:52:08 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 44352. Apr 13 20:52:08 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:52:08 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039579 Apr 13 20:52:08 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 367/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:52:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:52:41 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:52:41 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-997d04fd-a72d-4699-8bbd-eec875cf6445 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 200 len: 1769 microversion: 2.87 time: 0.186244 Apr 13 20:52:41 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 370/1102] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:52:41 2023] GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 1769 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:53:41 user devstack@n-api.service[61655]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f25dcc31-a02f-4471-a359-0963fc9a2bc3] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:53:41 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:53:41 user devstack@n-api.service[61655]: Thu Apr 13 20:53:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9/action (ip 10.0.0.210) !!! Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "4e93d2b2-ab18-409f-a26e-e7b446406efb"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:53:41 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'flavor' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 20:53:42 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9/action" status: 200 len: 29 microversion: 2.87 time: 0.503378 Apr 13 20:53:42 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 366/1103] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 20:53:41 2023] POST /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9/action => generated 29 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:53:42 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:53:42 user devstack@n-api.service[61654]: Thu Apr 13 20:53:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 (ip 10.0.0.210) !!! Apr 13 20:53:42 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:53:42 user devstack@n-api.service[61654]: Thu Apr 13 20:53:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 (ip 10.0.0.210) !!! Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:53:42 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:53:42 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-310494da-3425-4a59-9fc2-7b59b848442b tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 200 len: 1775 microversion: 2.87 time: 0.215055 Apr 13 20:53:42 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 368/1104] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:53:42 2023] GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 1775 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:53:42 user devstack@n-api.service[61653]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6dca22d-8e22-4cfa-b3c1-79b4a8e784ca] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 20:53:42 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:53:42 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:53:42 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:53:42 user devstack@n-api.service[61653]: Thu Apr 13 20:53:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 13 20:53:42 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-unplugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:53:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:53:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:53:42 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:53:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] Creating event network-vif-unplugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:53:42 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040269 Apr 13 20:53:42 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 371/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 20:53:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:53:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:53:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:53:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:53:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:53:44 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] [f25dcc31-a02f-4471-a359-0963fc9a2bc3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 35972. Apr 13 20:53:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032430 Apr 13 20:53:44 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 367/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:53:47 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:53:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:53:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:53:47 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:53:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:53:47 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032766 Apr 13 20:53:47 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 369/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:53:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:53:49 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:53:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:53:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:53:49 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:53:49 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6dca22d-8e22-4cfa-b3c1-79b4a8e784ca] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 44300. Apr 13 20:53:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:53:49 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032305 Apr 13 20:53:49 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 372/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:54:32 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:54:32 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-ed641ec9-67e8-4d7e-83a8-572928a26a54 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 200 len: 1755 microversion: 2.87 time: 0.275556 Apr 13 20:54:32 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 368/1109] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:54:32 2023] GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 1755 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:55:32 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:55:32 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9/action" status: 202 len: 0 microversion: 2.87 time: 0.102371 Apr 13 20:55:32 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 370/1110] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 20:55:32 2023] POST /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 20:55:32 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:55:32 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:55:32 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:55:32 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:55:33 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:55:33 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-892d6d1d-ac69-469f-9a2a-abaa90302eb3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 200 len: 1763 microversion: 2.87 time: 0.223731 Apr 13 20:55:33 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 373/1111] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:55:32 2023] GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 1763 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:55:33 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:55:33 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:55:33 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-unplugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:55:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:55:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:55:33 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:55:33 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] Creating event network-vif-unplugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:55:33 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042366 Apr 13 20:55:33 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 369/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:55:35 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}, {"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:55:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:55:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:55:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:55:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:55:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:55:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036882 Apr 13 20:55:35 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 371/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:55:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:55:37 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:55:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:55:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:55:37 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:55:37 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 20:55:37 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030032 Apr 13 20:55:37 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 374/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:55:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:56:23 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:56:23 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c54cc869-e523-4a46-bc0e-39a2df0fd972 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 200 len: 1769 microversion: 2.87 time: 0.157256 Apr 13 20:56:23 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 370/1115] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:56:23 2023] GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 1769 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:57:23 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:57:23 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:57:23 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:57:23 user devstack@n-api.service[61654]: Thu Apr 13 20:57:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 13 20:57:23 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:57:23 user devstack@n-api.service[61654]: Thu Apr 13 20:57:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 13 20:57:23 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1875948222", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "b179b938-6cf3-4860-b1ac-e243ded4df5f"}]}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:57:23 user devstack@n-api.service[61654]: DEBUG nova.network.neutron [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] validate_networks() for [('b179b938-6cf3-4860-b1ac-e243ded4df5f', None, None, None, None, None)] {{(pid=61654) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61654) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting quotas for project c9873771332b48b78929463707ce74d0. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.quota [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting quotas for user ce4e20ca99b8451c9087c565778ab88f and project c9873771332b48b78929463707ce74d0. Resources: {'instances', 'cores', 'ram'} {{(pid=61654) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Going to run 1 instances... {{(pid=61654) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 20:57:24 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61654) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 20:57:24 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.634100 Apr 13 20:57:24 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 372/1116] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 20:57:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 20:57:24 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:57:24 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:57:24 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:57:24 user devstack@n-api.service[61653]: Thu Apr 13 20:57:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 (ip 10.0.0.210) !!! Apr 13 20:57:24 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 20:57:24 user devstack@n-api.service[61653]: Thu Apr 13 20:57:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 (ip 10.0.0.210) !!! Apr 13 20:57:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-f35fdd10-c93f-4b94-821c-9b747fc1d94e tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:57:24 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-f35fdd10-c93f-4b94-821c-9b747fc1d94e tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:57:24 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-f35fdd10-c93f-4b94-821c-9b747fc1d94e tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:57:24 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-f35fdd10-c93f-4b94-821c-9b747fc1d94e tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:57:24 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-f35fdd10-c93f-4b94-821c-9b747fc1d94e tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:57:24 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-f35fdd10-c93f-4b94-821c-9b747fc1d94e tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2" status: 200 len: 1395 microversion: 2.87 time: 0.137929 Apr 13 20:57:24 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 375/1117] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:57:24 2023] GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 => generated 1395 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:57:26 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:57:26 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:57:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec312720-9493-463e-96b6-2e659ac966b2", "tag": "58154f44-c606-4862-a417-27ec125c2d26"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:57:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:57:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:57:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:57:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] Creating event network-changed:58154f44-c606-4862-a417-27ec125c2d26 for instance ec312720-9493-463e-96b6-2e659ac966b2 on user Apr 13 20:57:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085075 Apr 13 20:57:26 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 371/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:57:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:57:28 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312720-9493-463e-96b6-2e659ac966b2", "name": "network-vif-plugged", "status": "completed", "tag": "58154f44-c606-4862-a417-27ec125c2d26"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:57:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:57:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:57:28 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:57:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] Creating event network-vif-plugged:58154f44-c606-4862-a417-27ec125c2d26 for instance ec312720-9493-463e-96b6-2e659ac966b2 on user Apr 13 20:57:28 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083952 Apr 13 20:57:28 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 373/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:57:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:57:30 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312720-9493-463e-96b6-2e659ac966b2", "name": "network-vif-plugged", "status": "completed", "tag": "58154f44-c606-4862-a417-27ec125c2d26"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:57:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:57:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:57:30 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:57:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] Creating event network-vif-plugged:58154f44-c606-4862-a417-27ec125c2d26 for instance ec312720-9493-463e-96b6-2e659ac966b2 on user Apr 13 20:57:30 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038845 Apr 13 20:57:30 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 376/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 20:57:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:58:14 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:58:14 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-52576cb7-3808-45b6-abb8-10899c9a8c1c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2" status: 200 len: 1691 microversion: 2.87 time: 0.227546 Apr 13 20:58:14 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 372/1121] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:58:14 2023] GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 => generated 1691 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-907911854"}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:59:14 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:59:15 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2/action" status: 202 len: 52 microversion: 2.87 time: 0.827482 Apr 13 20:59:15 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 374/1122] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 20:59:14 2023] POST /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2/action => generated 52 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell0:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:59:20 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 20:59:20 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-866eac09-cb73-41e8-9873-9c8ed97d6425 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2" status: 200 len: 1691 microversion: 2.87 time: 0.177505 Apr 13 20:59:20 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 377/1123] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 20:59:20 2023] GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:00:21 user devstack@n-api.service[61655]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f25dcc31-a02f-4471-a359-0963fc9a2bc3] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:21 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:00:21 user devstack@n-api.service[61655]: Thu Apr 13 21:00:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 13 21:00:21 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:00:21 user devstack@n-api.service[61655]: Thu Apr 13 21:00:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 13 21:00:21 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:00:21 user devstack@n-api.service[61655]: Thu Apr 13 21:00:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-646592594", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "89a0e641-f418-4fdd-8f20-480666e0188c", "destination_type": "volume"}], "networks": [{"uuid": "b179b938-6cf3-4860-b1ac-e243ded4df5f"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] validate_networks() for [('b179b938-6cf3-4860-b1ac-e243ded4df5f', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting quotas for project c9873771332b48b78929463707ce74d0. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting quotas for user ce4e20ca99b8451c9087c565778ab88f and project c9873771332b48b78929463707ce74d0. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:00:21 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:00:21 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.826449 Apr 13 21:00:21 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 373/1124] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 21:00:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:00:21 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:21 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:21 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-43adff73-34f4-401f-8b4b-f772689639b5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:00:21 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-43adff73-34f4-401f-8b4b-f772689639b5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:00:21 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-43adff73-34f4-401f-8b4b-f772689639b5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:00:21 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-43adff73-34f4-401f-8b4b-f772689639b5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:00:21 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-43adff73-34f4-401f-8b4b-f772689639b5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:00:21 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-43adff73-34f4-401f-8b4b-f772689639b5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 200 len: 1394 microversion: 2.87 time: 0.094841 Apr 13 21:00:21 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 375/1125] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:00:21 2023] GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 1394 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:00:24 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:00:24 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:24 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:24 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:00:24 user devstack@n-api.service[61653]: Thu Apr 13 21:00:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 13 21:00:24 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:00:24 user devstack@n-api.service[61653]: Thu Apr 13 21:00:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 13 21:00:24 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:00:24 user devstack@n-api.service[61653]: Thu Apr 13 21:00:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 13 21:00:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:00:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:00:25 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:00:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] Creating event network-changed:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:00:25 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047173 Apr 13 21:00:25 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 378/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:00:36 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:36 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:36 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:36 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:36 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:00:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:00:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:00:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:00:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:00:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043633 Apr 13 21:00:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 374/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:00:38 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:00:38 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:38 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:00:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:00:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:00:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:00:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:00:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 Apr 13 21:00:38 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 376/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:00:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:01:12 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:01:12 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-296baa21-9dcd-4f82-8524-d7cb9a9119dc tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 200 len: 1768 microversion: 2.87 time: 0.181706 Apr 13 21:01:12 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 379/1129] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:01:12 2023] GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 1768 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:02:12 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] [f25dcc31-a02f-4471-a359-0963fc9a2bc3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60004. Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "b424b145-85f8-4e10-be14-bd32fe2f4582"}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:02:12 user devstack@n-api.service[61655]: DEBUG nova.objects.instance [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'flavor' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=61655) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:02:12 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe/action" status: 200 len: 29 microversion: 2.87 time: 0.333835 Apr 13 21:02:12 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 375/1130] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:02:12 2023] POST /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe/action => generated 29 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:02:12 user devstack@n-api.service[61654]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:02:12 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:02:13 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:02:13 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:02:13 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:02:13 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-2ad9a4ed-adfb-4274-a3e9-0253ee360e2c tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 200 len: 1774 microversion: 2.87 time: 0.191358 Apr 13 21:02:13 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 377/1131] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:02:12 2023] GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 1774 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:02:13 user devstack@n-api.service[61653]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6dca22d-8e22-4cfa-b3c1-79b4a8e784ca] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 21:02:13 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:02:13 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:02:13 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-unplugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:02:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:02:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:02:13 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:02:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] Creating event network-vif-unplugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:02:13 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040562 Apr 13 21:02:13 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 380/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:02:15 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:02:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:02:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:02:15 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:02:15 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:02:15 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032264 Apr 13 21:02:15 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 376/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:02:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:02:17 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:02:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:02:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:02:17 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:02:17 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:02:17 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47874. Apr 13 21:02:17 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030703 Apr 13 21:02:17 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 378/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:02:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:02:19 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:02:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:02:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:02:19 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:02:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:02:19 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030647 Apr 13 21:02:19 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 381/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:02:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:03:03 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:03:03 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-c7d7486a-75b1-434f-9666-7bd627be6bc3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 200 len: 1754 microversion: 2.87 time: 0.182633 Apr 13 21:03:03 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 377/1136] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:03:03 2023] GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:04:03 user devstack@n-api.service[61654]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:03 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:03 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "POST /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe/action" status: 202 len: 0 microversion: 2.87 time: 0.081791 Apr 13 21:04:03 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 379/1137] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:04:03 2023] POST /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:04:03 user devstack@n-api.service[61653]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6dca22d-8e22-4cfa-b3c1-79b4a8e784ca] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:04:03 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:04:03 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-43fb1dec-1cc9-44d4-bb39-0ba6f641d2ca tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 200 len: 1762 microversion: 2.87 time: 0.424552 Apr 13 21:04:03 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 382/1138] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:04:03 2023] GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 1762 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:04:04 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:04:04 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:04:04 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-unplugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:04:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:04 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] Creating event network-vif-unplugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:04:04 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092038 Apr 13 21:04:04 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 378/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:04:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:04:06 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}, {"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:04:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:06 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:04:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:04:06 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49222. Apr 13 21:04:06 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037507 Apr 13 21:04:06 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 380/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:04:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:04:08 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:04:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:08 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:04:08 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039638 Apr 13 21:04:08 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 383/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:04:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:04:54 user devstack@n-api.service[61655]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f25dcc31-a02f-4471-a359-0963fc9a2bc3] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:04:54 user devstack@n-api.service[61655]: DEBUG nova.policy [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61655) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:04:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-0284d148-2a56-4fa7-aa7d-6f13f1ed12f1 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 200 len: 1768 microversion: 2.87 time: 0.226341 Apr 13 21:04:54 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 379/1142] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:04:54 2023] GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 1768 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=4 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:05:54 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:05:54 user devstack@n-api.service[61654]: Thu Apr 13 21:05:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe (ip 10.0.0.210) !!! Apr 13 21:05:54 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:05:54 user devstack@n-api.service[61654]: Thu Apr 13 21:05:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe (ip 10.0.0.210) !!! Apr 13 21:05:54 user devstack@n-api.service[61654]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:05:54 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:05:54 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 204 len: 0 microversion: 2.87 time: 0.315208 Apr 13 21:05:54 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 381/1143] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:05:54 2023] DELETE /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:05:54 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:05:54 user devstack@n-api.service[61653]: Thu Apr 13 21:05:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe (ip 10.0.0.210) !!! Apr 13 21:05:54 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:05:54 user devstack@n-api.service[61653]: Thu Apr 13 21:05:54 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe (ip 10.0.0.210) !!! Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:05:54 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6dca22d-8e22-4cfa-b3c1-79b4a8e784ca] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49238. Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:05:54 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:05:54 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-b306b42b-f54c-46f4-b92d-ab9ee7d89712 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 200 len: 1774 microversion: 2.87 time: 0.221283 Apr 13 21:05:54 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 384/1144] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:05:54 2023] GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 1774 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:05:54 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:05:54 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:05:54 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-unplugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:05:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:05:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:05:54 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:05:54 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] [f25dcc31-a02f-4471-a359-0963fc9a2bc3] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 39310. Apr 13 21:05:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] Creating event network-vif-unplugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:05:54 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041334 Apr 13 21:05:54 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 380/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:05:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:05:56 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 35598. Apr 13 21:05:56 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-0d8e0901-7463-4f6a-928a-f8b8a0bc6261 req-e36c5739-8da0-4410-93a1-c45c7dd861c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-deleted", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:05:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0d8e0901-7463-4f6a-928a-f8b8a0bc6261 req-e36c5739-8da0-4410-93a1-c45c7dd861c3 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:05:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0d8e0901-7463-4f6a-928a-f8b8a0bc6261 req-e36c5739-8da0-4410-93a1-c45c7dd861c3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:05:56 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-0d8e0901-7463-4f6a-928a-f8b8a0bc6261 req-e36c5739-8da0-4410-93a1-c45c7dd861c3 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:05:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-0d8e0901-7463-4f6a-928a-f8b8a0bc6261 req-e36c5739-8da0-4410-93a1-c45c7dd861c3 service nova] Creating event network-vif-deleted:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:05:56 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-0d8e0901-7463-4f6a-928a-f8b8a0bc6261 req-e36c5739-8da0-4410-93a1-c45c7dd861c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149857 Apr 13 21:05:56 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 382/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:05:56 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02be72c4-1b93-4639-86f2-05570a6366fe", "name": "network-vif-plugged", "status": "completed", "tag": "16c9b002-957a-4236-9d73-299ca369d311"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:05:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:05:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:05:56 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:05:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] Creating event network-vif-plugged:16c9b002-957a-4236-9d73-299ca369d311 for instance 02be72c4-1b93-4639-86f2-05570a6366fe on user Apr 13 21:05:56 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032160 Apr 13 21:05:56 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 385/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] HTTP exception thrown: Instance 02be72c4-1b93-4639-86f2-05570a6366fe could not be found. Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Request method failure captured: Apr 13 21:06:44 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe HTTP/1.1 Apr 13 21:06:44 user devstack@n-api.service[61655]: Accept: application/json Apr 13 21:06:44 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 21:06:44 user devstack@n-api.service[61655]: Connection: close Apr 13 21:06:44 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 21:06:44 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 21:06:44 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 21:06:44 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 21:06:44 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGq0nt1r5XNsIw7oef0K7uzTRF817n-AelUuWVrQ5GAGMKyY29pInIKlEZ5FVSJcU9T_5U9uUbm066L-OOBnNJDkKkB4jpJ0Wk_0zOR_zxNe6GFlGNansm7V3qLkDo-f2JP04JE-C_pnZr9W2ZVDNOKP0v6t8m8GdoPvm6Pvkz4_Llg Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Project-Id: c9873771332b48b78929463707ce74d0 Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9873771332b48b78929463707ce74d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9873771332b48b78929463707ce74d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9873771332b48b78929463707ce74d0"}]}] Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Tenant-Id: c9873771332b48b78929463707ce74d0 Apr 13 21:06:44 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:06:44 user devstack@n-api.service[61655]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member Apr 13 21:06:44 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 21:06:44 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 21:06:44 user devstack@n-api.service[61655]: X-User-Id: ce4e20ca99b8451c9087c565778ab88f Apr 13 21:06:44 user devstack@n-api.service[61655]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member Apr 13 21:06:44 user devstack@n-api.service[61655]: method: > Apr 13 21:06:44 user devstack@n-api.service[61655]: exception: Instance 02be72c4-1b93-4639-86f2-05570a6366fe could not be found. Apr 13 21:06:44 user devstack@n-api.service[61655]: action_args: {'id': '02be72c4-1b93-4639-86f2-05570a6366fe'} Apr 13 21:06:44 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02be72c4-1b93-4639-86f2-05570a6366fe could not be found. Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02be72c4-1b93-4639-86f2-05570a6366fe could not be found. Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02be72c4-1b93-4639-86f2-05570a6366fe could not be found. Apr 13 21:06:44 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:06:44 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Returning 404 to user: Instance 02be72c4-1b93-4639-86f2-05570a6366fe could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:06:44 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-7d69fbf8-1b31-441c-8385-f66b499cb3f4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe" status: 404 len: 111 microversion: 2.87 time: 0.041088 Apr 13 21:06:44 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 381/1148] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:06:44 2023] GET /compute/v2.1/servers/02be72c4-1b93-4639-86f2-05570a6366fe => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:45 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:06:45 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2" status: 204 len: 0 microversion: 2.87 time: 0.118094 Apr 13 21:06:45 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 383/1149] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:06:45 2023] DELETE /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:06:45 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:06:45 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-7285f1d4-b00a-4333-b074-b955f8ec20e2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2" status: 200 len: 1697 microversion: 2.87 time: 0.187337 Apr 13 21:06:45 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 386/1150] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:06:45 2023] GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:06:45 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312720-9493-463e-96b6-2e659ac966b2", "name": "network-vif-unplugged", "status": "completed", "tag": "58154f44-c606-4862-a417-27ec125c2d26"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:06:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:45 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] Creating event network-vif-unplugged:58154f44-c606-4862-a417-27ec125c2d26 for instance ec312720-9493-463e-96b6-2e659ac966b2 on user Apr 13 21:06:45 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030121 Apr 13 21:06:45 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 382/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:06:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:06:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312720-9493-463e-96b6-2e659ac966b2", "name": "network-vif-deleted", "tag": "58154f44-c606-4862-a417-27ec125c2d26"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:06:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] Creating event network-vif-deleted:58154f44-c606-4862-a417-27ec125c2d26 for instance ec312720-9493-463e-96b6-2e659ac966b2 on user Apr 13 21:06:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030179 Apr 13 21:06:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 384/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:06:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:06:47 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec312720-9493-463e-96b6-2e659ac966b2", "name": "network-vif-plugged", "status": "completed", "tag": "58154f44-c606-4862-a417-27ec125c2d26"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:06:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:06:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:06:47 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:06:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] Creating event network-vif-plugged:58154f44-c606-4862-a417-27ec125c2d26 for instance ec312720-9493-463e-96b6-2e659ac966b2 on user Apr 13 21:06:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Apr 13 21:06:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 387/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:06:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:07:35 user devstack@n-api.service[61655]: INFO nova.api.openstack.wsgi [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] HTTP exception thrown: Instance ec312720-9493-463e-96b6-2e659ac966b2 could not be found. Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Request method failure captured: Apr 13 21:07:35 user devstack@n-api.service[61655]: request: GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 HTTP/1.1 Apr 13 21:07:35 user devstack@n-api.service[61655]: Accept: application/json Apr 13 21:07:35 user devstack@n-api.service[61655]: Accept-Encoding: identity Apr 13 21:07:35 user devstack@n-api.service[61655]: Connection: close Apr 13 21:07:35 user devstack@n-api.service[61655]: Content-Length: 0 Apr 13 21:07:35 user devstack@n-api.service[61655]: Content-Type: application/json Apr 13 21:07:35 user devstack@n-api.service[61655]: Host: 10.0.0.210 Apr 13 21:07:35 user devstack@n-api.service[61655]: Openstack-System-Scope: None Apr 13 21:07:35 user devstack@n-api.service[61655]: User-Agent: python-urllib3/1.26.15 Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Auth-Token: gAAAAABkOGq0nt1r5XNsIw7oef0K7uzTRF817n-AelUuWVrQ5GAGMKyY29pInIKlEZ5FVSJcU9T_5U9uUbm066L-OOBnNJDkKkB4jpJ0Wk_0zOR_zxNe6GFlGNansm7V3qLkDo-f2JP04JE-C_pnZr9W2ZVDNOKP0v6t8m8GdoPvm6Pvkz4_Llg Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Domain-Id: None Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Domain-Name: None Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Identity-Status: Confirmed Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Is-Admin-Project: True Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Project-Domain-Id: default Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Project-Domain-Name: Default Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Project-Id: c9873771332b48b78929463707ce74d0 Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Role: reader,member Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Roles: reader,member Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9873771332b48b78929463707ce74d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9873771332b48b78929463707ce74d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9873771332b48b78929463707ce74d0"}]}] Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Tenant-Id: c9873771332b48b78929463707ce74d0 Apr 13 21:07:35 user devstack@n-api.service[61655]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:07:35 user devstack@n-api.service[61655]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member Apr 13 21:07:35 user devstack@n-api.service[61655]: X-User-Domain-Id: default Apr 13 21:07:35 user devstack@n-api.service[61655]: X-User-Domain-Name: Default Apr 13 21:07:35 user devstack@n-api.service[61655]: X-User-Id: ce4e20ca99b8451c9087c565778ab88f Apr 13 21:07:35 user devstack@n-api.service[61655]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member Apr 13 21:07:35 user devstack@n-api.service[61655]: method: > Apr 13 21:07:35 user devstack@n-api.service[61655]: exception: Instance ec312720-9493-463e-96b6-2e659ac966b2 could not be found. Apr 13 21:07:35 user devstack@n-api.service[61655]: action_args: {'id': 'ec312720-9493-463e-96b6-2e659ac966b2'} Apr 13 21:07:35 user devstack@n-api.service[61655]: {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec312720-9493-463e-96b6-2e659ac966b2 could not be found. Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec312720-9493-463e-96b6-2e659ac966b2 could not be found. Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec312720-9493-463e-96b6-2e659ac966b2 could not be found. Apr 13 21:07:35 user devstack@n-api.service[61655]: ERROR nova.api.openstack.wsgi Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Returning 404 to user: Instance ec312720-9493-463e-96b6-2e659ac966b2 could not be found. {{(pid=61655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:07:35 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-508253f2-b11c-4d46-8388-16daa11f0daf tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2" status: 404 len: 111 microversion: 2.87 time: 0.038484 Apr 13 21:07:35 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 383/1154] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:07:35 2023] GET /compute/v2.1/servers/ec312720-9493-463e-96b6-2e659ac966b2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:07:35 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Going to try to terminate instance {{(pid=61654) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:07:35 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 204 len: 0 microversion: 2.87 time: 0.117887 Apr 13 21:07:35 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 385/1155] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:07:35 2023] DELETE /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=8 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:07:35 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:07:35 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-05a37c75-cf8d-4e48-9cc7-c7fd016437a5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 200 len: 1775 microversion: 2.87 time: 0.188546 Apr 13 21:07:35 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 388/1156] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:07:35 2023] GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 1775 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:07:35 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-unplugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:07:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:07:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:07:36 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:07:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] Creating event network-vif-unplugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 21:07:36 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030704 Apr 13 21:07:36 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 384/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:07:38 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-plugged", "status": "completed", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}, {"server_uuid": "a559c005-897e-4c1c-bdc2-a2dce95573e9", "name": "network-vif-deleted", "tag": "ca77217a-aa63-4648-a54c-9f4d807d1acb"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:07:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:07:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:07:38 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:07:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Creating event network-vif-plugged:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 21:07:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Creating event network-vif-deleted:ca77217a-aa63-4648-a54c-9f4d807d1acb for instance a559c005-897e-4c1c-bdc2-a2dce95573e9 on user Apr 13 21:07:38 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030188 Apr 13 21:07:38 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 386/1158] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:07:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] HTTP exception thrown: Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 could not be found. Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Request method failure captured: Apr 13 21:08:26 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 HTTP/1.1 Apr 13 21:08:26 user devstack@n-api.service[61653]: Accept: application/json Apr 13 21:08:26 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 21:08:26 user devstack@n-api.service[61653]: Connection: close Apr 13 21:08:26 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 21:08:26 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 21:08:26 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 21:08:26 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 21:08:26 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGq0nt1r5XNsIw7oef0K7uzTRF817n-AelUuWVrQ5GAGMKyY29pInIKlEZ5FVSJcU9T_5U9uUbm066L-OOBnNJDkKkB4jpJ0Wk_0zOR_zxNe6GFlGNansm7V3qLkDo-f2JP04JE-C_pnZr9W2ZVDNOKP0v6t8m8GdoPvm6Pvkz4_Llg Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Project-Id: c9873771332b48b78929463707ce74d0 Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9873771332b48b78929463707ce74d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9873771332b48b78929463707ce74d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9873771332b48b78929463707ce74d0"}]}] Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Tenant-Id: c9873771332b48b78929463707ce74d0 Apr 13 21:08:26 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:08:26 user devstack@n-api.service[61653]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member Apr 13 21:08:26 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 21:08:26 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 21:08:26 user devstack@n-api.service[61653]: X-User-Id: ce4e20ca99b8451c9087c565778ab88f Apr 13 21:08:26 user devstack@n-api.service[61653]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member Apr 13 21:08:26 user devstack@n-api.service[61653]: method: > Apr 13 21:08:26 user devstack@n-api.service[61653]: exception: Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 could not be found. Apr 13 21:08:26 user devstack@n-api.service[61653]: action_args: {'id': 'a559c005-897e-4c1c-bdc2-a2dce95573e9'} Apr 13 21:08:26 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 could not be found. Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 could not be found. Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 could not be found. Apr 13 21:08:26 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Returning 404 to user: Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:08:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-d6942b76-052b-4703-8276-d7929e8f62a2 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9" status: 404 len: 111 microversion: 2.87 time: 0.039575 Apr 13 21:08:26 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 389/1159] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:08:26 2023] GET /compute/v2.1/servers/a559c005-897e-4c1c-bdc2-a2dce95573e9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:08:26 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:08:26 user devstack@n-api.service[61655]: Thu Apr 13 21:08:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 (ip 10.0.0.210) !!! Apr 13 21:08:26 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:08:26 user devstack@n-api.service[61655]: Thu Apr 13 21:08:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 (ip 10.0.0.210) !!! Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:26 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:08:26 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" status: 204 len: 0 microversion: 2.87 time: 0.122036 Apr 13 21:08:26 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 385/1160] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:08:26 2023] DELETE /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:08:26 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:08:26 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-1f40e9ff-83c6-4a9b-96cf-fa84457d27ce tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" status: 200 len: 1695 microversion: 2.87 time: 0.402939 Apr 13 21:08:26 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 387/1161] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:08:26 2023] GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => generated 1695 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9", "name": "network-vif-unplugged", "status": "completed", "tag": "7010d8a1-cb74-49c7-9be0-dc0da456ad67"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:26 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] Creating event network-vif-unplugged:7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 on user Apr 13 21:08:26 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115292 Apr 13 21:08:26 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 390/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:08:27 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-9529cece-22b8-41bc-9408-2bb040fd87c1 req-1d7f6293-4839-4478-a3de-7a2a5f55c104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9", "name": "network-vif-deleted", "tag": "7010d8a1-cb74-49c7-9be0-dc0da456ad67"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:08:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9529cece-22b8-41bc-9408-2bb040fd87c1 req-1d7f6293-4839-4478-a3de-7a2a5f55c104 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9529cece-22b8-41bc-9408-2bb040fd87c1 req-1d7f6293-4839-4478-a3de-7a2a5f55c104 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:27 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-9529cece-22b8-41bc-9408-2bb040fd87c1 req-1d7f6293-4839-4478-a3de-7a2a5f55c104 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:27 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-9529cece-22b8-41bc-9408-2bb040fd87c1 req-1d7f6293-4839-4478-a3de-7a2a5f55c104 service nova] Creating event network-vif-deleted:7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 on user Apr 13 21:08:27 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-9529cece-22b8-41bc-9408-2bb040fd87c1 req-1d7f6293-4839-4478-a3de-7a2a5f55c104 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Apr 13 21:08:27 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 386/1163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:08:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:08:29 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9", "name": "network-vif-plugged", "status": "completed", "tag": "7010d8a1-cb74-49c7-9be0-dc0da456ad67"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:08:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:08:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:08:29 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:08:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] Creating event network-vif-plugged:7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 on user Apr 13 21:08:29 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032738 Apr 13 21:08:29 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 388/1164] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=4 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:09:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.wsgi [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] HTTP exception thrown: Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 could not be found. Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Request method failure captured: Apr 13 21:09:16 user devstack@n-api.service[61653]: request: GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 HTTP/1.1 Apr 13 21:09:16 user devstack@n-api.service[61653]: Accept: application/json Apr 13 21:09:16 user devstack@n-api.service[61653]: Accept-Encoding: identity Apr 13 21:09:16 user devstack@n-api.service[61653]: Connection: close Apr 13 21:09:16 user devstack@n-api.service[61653]: Content-Length: 0 Apr 13 21:09:16 user devstack@n-api.service[61653]: Content-Type: application/json Apr 13 21:09:16 user devstack@n-api.service[61653]: Host: 10.0.0.210 Apr 13 21:09:16 user devstack@n-api.service[61653]: Openstack-System-Scope: None Apr 13 21:09:16 user devstack@n-api.service[61653]: User-Agent: python-urllib3/1.26.15 Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Auth-Token: gAAAAABkOGq0nt1r5XNsIw7oef0K7uzTRF817n-AelUuWVrQ5GAGMKyY29pInIKlEZ5FVSJcU9T_5U9uUbm066L-OOBnNJDkKkB4jpJ0Wk_0zOR_zxNe6GFlGNansm7V3qLkDo-f2JP04JE-C_pnZr9W2ZVDNOKP0v6t8m8GdoPvm6Pvkz4_Llg Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Domain-Id: None Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Domain-Name: None Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Identity-Status: Confirmed Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Is-Admin-Project: True Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Project-Domain-Id: default Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Project-Domain-Name: Default Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Project-Id: c9873771332b48b78929463707ce74d0 Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Role: reader,member Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Roles: reader,member Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9873771332b48b78929463707ce74d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9873771332b48b78929463707ce74d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9873771332b48b78929463707ce74d0"}]}] Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Tenant-Id: c9873771332b48b78929463707ce74d0 Apr 13 21:09:16 user devstack@n-api.service[61653]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877 Apr 13 21:09:16 user devstack@n-api.service[61653]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member Apr 13 21:09:16 user devstack@n-api.service[61653]: X-User-Domain-Id: default Apr 13 21:09:16 user devstack@n-api.service[61653]: X-User-Domain-Name: Default Apr 13 21:09:16 user devstack@n-api.service[61653]: X-User-Id: ce4e20ca99b8451c9087c565778ab88f Apr 13 21:09:16 user devstack@n-api.service[61653]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member Apr 13 21:09:16 user devstack@n-api.service[61653]: method: > Apr 13 21:09:16 user devstack@n-api.service[61653]: exception: Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 could not be found. Apr 13 21:09:16 user devstack@n-api.service[61653]: action_args: {'id': 'fe45ba7c-ccc0-4eaa-930c-6600e036f3e9'} Apr 13 21:09:16 user devstack@n-api.service[61653]: {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 could not be found. Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 could not be found. Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 could not be found. Apr 13 21:09:16 user devstack@n-api.service[61653]: ERROR nova.api.openstack.wsgi Apr 13 21:09:16 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Returning 404 to user: Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 could not be found. {{(pid=61653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:09:16 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-1dd3bf4a-6675-4c31-89c9-55b991e9f1be tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" status: 404 len: 111 microversion: 2.87 time: 0.039213 Apr 13 21:09:16 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 391/1165] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:09:16 2023] GET /compute/v2.1/servers/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:09:49 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:09:49 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:09:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2145808937", "imageRef": "89a0e641-f418-4fdd-8f20-480666e0188c", "flavorRef": "42", "networks": [{"uuid": "a8fd556a-48ba-4a57-96ce-322901415e31"}]}} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:09:49 user devstack@n-api.service[61655]: DEBUG nova.network.neutron [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] validate_networks() for [('a8fd556a-48ba-4a57-96ce-322901415e31', None, None, None, None, None)] {{(pid=61655) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Flavor limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Image limits 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Flavor pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Image pref 0:0:0 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61655) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Getting quotas for project 413fbcd3c8f14d5bae809dc4a7f1acf9. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.quota [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Getting quotas for user b257c12138104e35a1d01a5614746f95 and project 413fbcd3c8f14d5bae809dc4a7f1acf9. Resources: {'instances', 'cores', 'ram'} {{(pid=61655) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Going to run 1 instances... {{(pid=61655) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:09:50 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89a0e641-f418-4fdd-8f20-480666e0188c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61655) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:09:50 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.737612 Apr 13 21:09:50 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 387/1166] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:09:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:09:50 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:09:50 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=8 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:09:50 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-9407bfff-176e-4320-974f-ce05ffc0e8ce tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:09:50 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-9407bfff-176e-4320-974f-ce05ffc0e8ce tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:09:50 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-9407bfff-176e-4320-974f-ce05ffc0e8ce tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b257c12138104e35a1d01a5614746f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413fbcd3c8f14d5bae809dc4a7f1acf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:09:50 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-9407bfff-176e-4320-974f-ce05ffc0e8ce tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10" status: 200 len: 1208 microversion: 2.1 time: 0.069428 Apr 13 21:09:50 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 389/1167] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:09:50 2023] GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 => generated 1208 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:09:52 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd531840-5dda-4126-be71-9a7352f34e10", "tag": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:09:52 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:09:52 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:09:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:09:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:09:52 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:09:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] Creating event network-changed:81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance bd531840-5dda-4126-be71-9a7352f34e10 on user Apr 13 21:09:52 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041226 Apr 13 21:09:52 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 392/1168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:09:55 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd531840-5dda-4126-be71-9a7352f34e10", "name": "network-vif-plugged", "status": "completed", "tag": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:09:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:09:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:09:55 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:09:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] Creating event network-vif-plugged:81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance bd531840-5dda-4126-be71-9a7352f34e10 on user Apr 13 21:09:55 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032745 Apr 13 21:09:55 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 388/1169] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:09:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:09:57 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd531840-5dda-4126-be71-9a7352f34e10", "name": "network-vif-plugged", "status": "completed", "tag": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a"}]} {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:09:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:09:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:09:57 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:09:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.compute.server_external_events [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] Creating event network-vif-plugged:81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance bd531840-5dda-4126-be71-9a7352f34e10 on user Apr 13 21:09:57 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034245 Apr 13 21:09:57 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 390/1170] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:09:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:10:40 user devstack@n-api.service[61653]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6dca22d-8e22-4cfa-b3c1-79b4a8e784ca] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Calling method '>' {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG nova.compute.api [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Fetching instance by UUID {{(pid=61653) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:10:40 user devstack@n-api.service[61653]: DEBUG nova.policy [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b257c12138104e35a1d01a5614746f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413fbcd3c8f14d5bae809dc4a7f1acf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61653) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:10:40 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [None req-319e6a50-8055-46a0-b5d1-305fd17f6d5d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10" status: 200 len: 1486 microversion: 2.1 time: 0.249715 Apr 13 21:10:40 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 393/1171] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:10:40 2023] GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=2 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell0:SELECT=6 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61655]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:11:46 user devstack@n-api.service[61655]: Thu Apr 13 21:11:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 (ip 10.0.0.210) !!! Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG dbcounter [-] [61655] Writing DB stats nova_cell1:SELECT=4 {{(pid=61655) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Calling method '>' {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Fetching instance by UUID {{(pid=61655) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:11:46 user devstack@n-api.service[61655]: DEBUG nova.compute.api [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Going to try to terminate instance {{(pid=61655) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:11:46 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10" status: 204 len: 0 microversion: 2.1 time: 0.148562 Apr 13 21:11:46 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 389/1172] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:11:46 2023] DELETE /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell0:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:11:46 user devstack@n-api.service[61654]: Thu Apr 13 21:11:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 (ip 10.0.0.210) !!! Apr 13 21:11:46 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 21:11:46 user devstack@n-api.service[61654]: Thu Apr 13 21:11:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 (ip 10.0.0.210) !!! Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:11:46 user devstack@n-api.service[61654]: DEBUG nova.policy [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b257c12138104e35a1d01a5614746f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413fbcd3c8f14d5bae809dc4a7f1acf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61654) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:11:46 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-ac41a92a-7f27-4656-97eb-3353c7578d05 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10" status: 200 len: 1492 microversion: 2.1 time: 0.192122 Apr 13 21:11:46 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 391/1173] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:11:46 2023] GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 => generated 1492 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:11:46 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_api:SELECT=2 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61653]: DEBUG dbcounter [-] [61653] Writing DB stats nova_cell1:SELECT=6 {{(pid=61653) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:11:46 user devstack@n-api.service[61653]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6dca22d-8e22-4cfa-b3c1-79b4a8e784ca] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 56722. Apr 13 21:11:46 user devstack@n-api.service[61653]: DEBUG nova.api.openstack.wsgi [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd531840-5dda-4126-be71-9a7352f34e10", "name": "network-vif-unplugged", "status": "completed", "tag": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a"}]} {{(pid=61653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:11:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:11:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:11:46 user devstack@n-api.service[61653]: DEBUG oslo_concurrency.lockutils [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61653) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:11:46 user devstack@n-api.service[61653]: INFO nova.api.openstack.compute.server_external_events [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] Creating event network-vif-unplugged:81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance bd531840-5dda-4126-be71-9a7352f34e10 on user Apr 13 21:11:47 user devstack@n-api.service[61653]: INFO nova.api.openstack.requestlog [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107581 Apr 13 21:11:47 user devstack@n-api.service[61653]: [pid: 61653|app: 0|req: 394/1174] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:11:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:11:49 user devstack@n-api.service[61655]: DEBUG nova.api.openstack.wsgi [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd531840-5dda-4126-be71-9a7352f34e10", "name": "network-vif-plugged", "status": "completed", "tag": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a"}, {"server_uuid": "bd531840-5dda-4126-be71-9a7352f34e10", "name": "network-vif-deleted", "tag": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a"}]} {{(pid=61655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:11:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:11:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:11:49 user devstack@n-api.service[61655]: DEBUG oslo_concurrency.lockutils [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61655) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:11:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Creating event network-vif-plugged:81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance bd531840-5dda-4126-be71-9a7352f34e10 on user Apr 13 21:11:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.compute.server_external_events [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Creating event network-vif-deleted:81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance bd531840-5dda-4126-be71-9a7352f34e10 on user Apr 13 21:11:49 user devstack@n-api.service[61655]: INFO nova.api.openstack.requestlog [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030259 Apr 13 21:11:49 user devstack@n-api.service[61655]: [pid: 61655|app: 0|req: 390/1175] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:11:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113813c1-f3e9-4f45-b5ed-fa39b4975de7] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Calling method '>' {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG nova.compute.api [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Fetching instance by UUID {{(pid=61654) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_api:SELECT=2 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG dbcounter [-] [61654] Writing DB stats nova_cell1:SELECT=6 {{(pid=61654) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:12:36 user devstack@n-api.service[61654]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 13 21:12:36 user devstack@n-api.service[61654]: Thu Apr 13 21:12:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 (ip 10.0.0.210) !!! Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "c581c091-39a2-47af-87ba-30e69c5146d4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG oslo_concurrency.lockutils [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "c581c091-39a2-47af-87ba-30e69c5146d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61654) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:12:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.wsgi [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] HTTP exception thrown: Instance bd531840-5dda-4126-be71-9a7352f34e10 could not be found. Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Request method failure captured: Apr 13 21:12:36 user devstack@n-api.service[61654]: request: GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 HTTP/1.1 Apr 13 21:12:36 user devstack@n-api.service[61654]: Accept: application/json Apr 13 21:12:36 user devstack@n-api.service[61654]: Accept-Encoding: identity Apr 13 21:12:36 user devstack@n-api.service[61654]: Connection: close Apr 13 21:12:36 user devstack@n-api.service[61654]: Content-Length: 0 Apr 13 21:12:36 user devstack@n-api.service[61654]: Content-Type: application/json Apr 13 21:12:36 user devstack@n-api.service[61654]: Host: 10.0.0.210 Apr 13 21:12:36 user devstack@n-api.service[61654]: Openstack-System-Scope: None Apr 13 21:12:36 user devstack@n-api.service[61654]: User-Agent: python-urllib3/1.26.15 Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Auth-Token: gAAAAABkOG-cguAusebnbrHbIpTd-XxUHykHDnT6QffGw2tpWR8BI72ncQBGDJ4ZDy3t_eIWtuqbJYgSXfvA_BHQBu4Iza6stzvhvWxfJji-kAITntBCtluMF5NgFEt1YuTey7THNglJ56kShpP71Hl75kOWCTVpqS-jbzm6DvDVbEV0REkCCHk Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Domain-Id: None Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Domain-Name: None Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Identity-Status: Confirmed Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Is-Admin-Project: True Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Project-Domain-Id: default Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Project-Domain-Name: Default Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Project-Id: 413fbcd3c8f14d5bae809dc4a7f1acf9 Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Project-Name: tempest-VolumesActionsTest-1712081347 Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Role: reader,member Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Roles: reader,member Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/413fbcd3c8f14d5bae809dc4a7f1acf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/413fbcd3c8f14d5bae809dc4a7f1acf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/413fbcd3c8f14d5bae809dc4a7f1acf9"}]}] Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Tenant: tempest-VolumesActionsTest-1712081347 Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Tenant-Id: 413fbcd3c8f14d5bae809dc4a7f1acf9 Apr 13 21:12:36 user devstack@n-api.service[61654]: X-Tenant-Name: tempest-VolumesActionsTest-1712081347 Apr 13 21:12:36 user devstack@n-api.service[61654]: X-User: tempest-VolumesActionsTest-1712081347-project-member Apr 13 21:12:36 user devstack@n-api.service[61654]: X-User-Domain-Id: default Apr 13 21:12:36 user devstack@n-api.service[61654]: X-User-Domain-Name: Default Apr 13 21:12:36 user devstack@n-api.service[61654]: X-User-Id: b257c12138104e35a1d01a5614746f95 Apr 13 21:12:36 user devstack@n-api.service[61654]: X-User-Name: tempest-VolumesActionsTest-1712081347-project-member Apr 13 21:12:36 user devstack@n-api.service[61654]: method: > Apr 13 21:12:36 user devstack@n-api.service[61654]: exception: Instance bd531840-5dda-4126-be71-9a7352f34e10 could not be found. Apr 13 21:12:36 user devstack@n-api.service[61654]: action_args: {'id': 'bd531840-5dda-4126-be71-9a7352f34e10'} Apr 13 21:12:36 user devstack@n-api.service[61654]: {{(pid=61654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd531840-5dda-4126-be71-9a7352f34e10 could not be found. Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd531840-5dda-4126-be71-9a7352f34e10 could not be found. Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd531840-5dda-4126-be71-9a7352f34e10 could not be found. Apr 13 21:12:36 user devstack@n-api.service[61654]: ERROR nova.api.openstack.wsgi Apr 13 21:12:36 user devstack@n-api.service[61654]: DEBUG nova.api.openstack.wsgi [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Returning 404 to user: Instance bd531840-5dda-4126-be71-9a7352f34e10 could not be found. {{(pid=61654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:12:36 user devstack@n-api.service[61654]: INFO nova.api.openstack.requestlog [None req-359b008e-f08f-4b97-92ff-646ae26c2ce2 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10" status: 404 len: 111 microversion: 2.1 time: 0.045303 Apr 13 21:12:36 user devstack@n-api.service[61654]: [pid: 61654|app: 0|req: 392/1176] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:12:36 2023] GET /compute/v2.1/servers/bd531840-5dda-4126-be71-9a7352f34e10 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)